Actually, AIs have been training on AI-generated content for a long time now. An example of this is student-teacher distillation.