There are first studies on this topic: "THE CURSE OF RECURSION: TRAINING ON GENERATED DATA MAKES MODELS FORGET"

https://arxiv.org/pdf/2305.17493.pdf