Humans use synthetic data of their own to help with learning. Reasoning, imagination, armchair philosophy, theoreticizing, and neurosciences talk about dream repetition.
If synthetic daa is bad or flawed its only temporary until the technique gets further honed.