I believe illustrations have been deemed to be abuse material, so I wouldn’t be surprised if LE have started looking into it.
I for one would much rather give pedophiles an opportunity to fulfil their sexual desires through AI-generated pictures than real ones.
Of course, we can talk about the training material. Are there actual child porn images in there? I seriously doubt it but who knows?
And perhaps a case could be made that AI-generated child porn could be a gateway to invite people who then seek out non-generated material.
But I think these are separate discussions to be had.
So if either case applies, whether it's training based on certain images, or it becomes a gateway, these are discussions to be had directly relating to whether or not it should be classified as abuse material.
Additionally, I'm not sure if the recommended help methods by professionals who deal with pedophiles is to let them fulfill their specific fantasies without a care.
There are lots of really important discussions to be had, but they're all tied to each other basically. We can't separate them out, nor should we aim to.
I just wanted to clarify that I did not mean that these topics are all unrelated. When I wrote that these are separate discussions to be had, I was rather trying to imply that these questions are important enough to deserve an own treatment. However, I do agree with you that in the end, they all contribute to the question whether or not artificially generated child porn is abusive or not.
I do appreciate another sibling comment that points out the relation to other fictional child porn, such as literary works.
Additionally, I would like to add another dimension to the topic, namely that IMO, there is often an unspoken underlying assumption that portraits consumers of child porn as (potential) predators. However, unlike a juvenile delinquent who might find it cool to break into a local corner shop at night to steal some cans of beer, pedophiles are usually not attracted to child porn as a matter of choice. Like many sexual preferences, it is often innate, and can also be a burden to them: imagine you know that what gets you on is morally wrong, even a crime, and for most of your life you are forced to suppress your real sexuality as a consequence.
I'm thinking that fictional child porn, even when it's not AI-based but perhaps created with photoshop or in form of stories, could potentially help pedophiles to find ways of somehow dealing with their sexuality without actually preying on innocent children.
However, all of these thoughts come from a very naive understanding of the subject matter. Neither am I a pedophile myself, nor do I know anyone who is, nor am I a psychologist or something who works in the field. So I am very interested in corrections or additional options - especially, as I pointed out before, if they are done in equally civil ways as they have been so far in this thread.
It’s kinda like arguing that racism is a fact of life for some and we should allow them to vent their racism in a controlled environment. Hard disagree.
So would it be okay to distribute "revenge porn" imagery after the subject has died?
[1]: https://en.wikipedia.org/wiki/Legal_status_of_fictional_porn...
In my opinion instances should let the user decide what they find problematic or not and unless it's just spam they shouldn't ban instances.
To me it's akin to encryption being used for illicit/illegal activities. Any tool that gives power to people can and will be abused by people you'd want nothing to do with.
What did you have in mind?
It all seems incredibly complex. Not a reason to "not try", but i suspect we'll struggle to implement even the most basic thing. And even then, take that basic thing and apply it to every software where users can input data.
Plus we'd have to convince everyone to do this. Automatic scanning and submission of data is not a well liked topic. Remember how Apple doing basic CSAM scanning was full of panic?
Even if a government _forced_ us to do this, jurisdiction alone would be a big question. Some serious questions that need some serious thought, imo. Is being hand-wavy even worth the time?
If it's so easy i'd love to see your implementation that works multi-language, across all media types, for all jurisdictions and hell handles burden all the massive number of edge cases.
Or frankly, any implementation. Whatever you think is easy and everyone should be doing - please point to an E2E implementation of it. Maybe i misunderstand your scope. Something where if a user submits CSAM, or does something to some country authority..?
there’s also negative prompting, which tells the model don’t do these things.
hallucinations can still happen but it’s much easier than you’re making it out to be.
I suspect we could use some sort of central management service for "Internet Reports". Ie to deal with jurisdictions, reporting something to the right people, etc, as well as the complexities involved with identifying people.
Either way i think you're underselling the complexity. Or maybe you think it's so easy but no one cares, /shrug. Seems a long list of questions i'd have before i could even begin to implement it.