What actual difference is there between a machine generating this material or a human being drawing it by hand? It seems like we're living with the "pretty serious consequences" already, and yet, it seems like we've found a way to manage those effectively already.
> if the model can produce that, how much of it does it need to be trained on to produce it? And they discovered the answer to that is very little.
The answer may very well be "none at all," particularly if these systems can create image fragments by inference and a different system or even a human can assemble them.
> are far beyond how I understand ML.
If you have a crappy product, get it regulated, it grants it the imprimatur of credibility and it hamstrings your competitors and startups in the space. An understanding of ML may not be required at all to understand this regulatory situation.