AI feels a lot to me like improv. It’s fun to watch, sometimes, and in experienced hands it can even be great - but it’s missing the crafted core of what makes something really good - the “thing” that great art becomes transparent before.
Your improv comparison resonates. I'd add that it also reflects the positives of improv. The freedom, being present, lower inhibition/impediments, the positive feedback loop of AI's "yes, and!". These are useful for the same reason improv is to written material. As a sketchbook, trying ideas and really finding the bellylaughs you write into the stage routine.