A huge problem with ML training is the ‘ouroboros issue’ - training ML with input from other MLs breaks things in very deep (but difficult to stop/detect when it’s happening) ways due to the way the internal math works (model collapse).

Right now, the Internet training set is becoming more and more contaminated with better and better generative AI images and video.

It makes the models more screwed up, and makes it very difficult for humans to figure out what is original and not too.

If there was some signal that could at least make it easier to identify ‘original’/real images…