"automated experimentation so it's able to generate new types of data to train itself"

AIs don't understand reality. This type of data generation would need a specific sort of validator function to work: we call this reality. That's what "experimentation" requires: reality.

We already have this right now, with the AI training ingesting AI crapgen, with StackOverflow posts no longer happening. That would seem to point to a degrading AI training set, not an improving one.