AI-generated naked child images shock Spanish town of Almendralejo
bbc.com
bbc.com
And critically, the one that's massively-available enough so as to be generated by 14 year olds.
Given how poorly the world dealt with the sudden duplicity of text as the web democratized publishing, it's going to be a crazy next couple decades.
I can't think of a good text analogue. People consume clickbait and such, but the producer's motivation is different, and the consumer isn't so consciously aware of its fakeness.
One can hope that humans just get desensitized to nudity... because now its going to be basically free.
Fox News posts rage-bait on their front page because it drives advertising revenue.
Fake-Your-Classmate.com (or whatever) operates their service because it drives either direct or advertising revenue.
And there's demand for the service... because 14 year olds are horny idiots with poor impulse control.
I don't expect the horny idiots with poor impulse control part to change, which means this is here to stay. Sadly.
In the 90s and 00s, I expect fake generation would have been packaged up and made available for local execution.
Now? In that age, there are a ton of mobile and/or walled garden users, even assuming technical sophistication.
But as a counterpoint, the resulting images are trivially shared. So only one member of a social group needs to have the production means for it to be a problem. :/