Avoiding Model Collapse via Accumulating Real and Synthetic Data

Title rewritten from the too long "Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data" , figured this might be of interest given https://news.ycombinator.com/item?id=41058194 and https://news.ycombinator.com/item?id=41058867