Cops bogged down by flood of fake AI child sex images, report says
arstechnica.com
arstechnica.com
> The troubling case seems to illustrate how AI-generated child sex images can be linked to real criminal activity while also showing how police investigations could be bogged down by attempts to distinguish photos of real victims from AI images that could depict real or fake children.
Even attempting to run such a pure observational study of such a situation would be denounced, even if the researchers had no power to alter the laws.
If you did somehow manage to run such a study, I expect you'd find three things: (1) plenty of examples of people who were inspired to act due to the images they saw, (2) plenty of examples of people who used the images as a way out, (3) that there are way more abusers and victims than most people realise.
If the AI version gets good enough, the supply of a substitute will real CP will go up, the price of real CP will go down, meaning there is less incentive to exploit real children.
The unreasonable assumptions you assert I'm making are of your own imagination.
But the exact opposite happened. The generation who murdered and robbed their way through the streets of San Andreas committed much less IRL crime than their parents generation.
They get hooked and start looking for more and more extreme content, eventually that escalation has them watching child abuse material, then then go from that to the real thing.
It might be why pedophilia seems to be more and more common post internet. If all you have is Hustler magazine you can't escalate to children.
I suspect (admittedly without evidence) that it's not more common—it's just more socially unacceptable, and also easier to get caught.
And I vaguely remember an 80s or 90s survey which said something like 1 in 6 American women were victimised as minors.
It’s only particularly relevant in the context of terms of trying to identify the source of abuse and trying to stop or interrupt that.
I've thought about it for 5 seconds, and it's not obvious to me.
The whole possession of images is a crime is already a stretch, justified by the very real observation that the market for these images necessarily fuels abuse of real children.
But AI images cut that link.
I'm in complete agreement that the content is odious. But there's plenty of stuff that's odious and legal.
1. Some people think free speech is a pretty good idea. And it doesn't really mean much if you only defend speech that you agree with.
2. There's pretty widespread agreement that drug crimes are inhumane and should be replaced with treatment. So-called "victimless crimes". IMO, AI CP has the exact same characteristics, but it's even less damaging to society - there's no chance that someone will get into a car crash because they're "using".
3. Convictions here absolutely destroy lives. The consequence of being convicted for possession of CP is not just jail (where people absolutely do get attacked by other inmates, often times fatally), but also registry on the sexual offender list.
Do people who indirectly hurt children deserve this fate - I guess, it's complicated. It does seem out of proportion to the punishments handed out to people who kill others with cars, for example. But I can certainly get on board with some sort of criminal consequences.
But if the "offender" doesn't hurt anyone, even indirectly, that does seem like an absolute nuclear warhead of a punishment for something that most people would struggle to explain why it's a crime at all other than "it's gross".
Child porn is not protected by the first amendment, just like it does not protect speech calling for lawless action
"Muh free speech" is very often the weakest argument in any kind of debate.
I hate this argument when applied like this. There is no universe whatsoever where images of this nature constitute speech. Even when taken as the abstract principle and not the law. The images don't convey any message or idea. There's nothing to agree or disagree with. Free speech doesn't protect mouth sounds or information transfer in abstract, it protects expressions of opinion and ideas. Now, if you went to a protest for legalization and made a sign with the images or made a display at an art gallery then you have a case that it's part of your free expression.
There is an argument for making free speech protections overbroad purposefully because we don't think government can be trusted to evaluate the nuance in good faith but this isn't one of those "well it's arguable as to whether it constitutes speech."
Not being speech doesn't mean it shouldn't be allowed, just that the reason it's allowed isn't free speech.
Do you think that ordinary porn constitutes speech, deserving of the protections of the First Amendment?
> The argument that eliminating the market for pornography produced using real children necessitates a prohibition on virtual images as well is somewhat implausible because few pornographers would risk prosecution for abusing real children if fictional, computerized images would suffice. Moreover, even if the market deterrence theory were persuasive, the argument cannot justify the CPPA because, here, there is no underlying crime at all. Finally, the First Amendment is turned upside down by the argument that, because it is difficult to distinguish between images made using real children and those produced by computer imaging, both kinds of images must be prohibited.
With the current composition of the court, I'm not convinced this precedent will hold up if a case reaches them. But until that happens, the law seems quite clear.
And none of these people likely received mental health care as compensation for that work.
Oh, and of course, "the police" consists of police officers. There's a joke where I live about the exam to become a police officer. There's just one question: "how much is 5+5?", and all answers between 2 and 17 EXCEPT 10 are correct ...
1. Real-world photographs of people, minors or otherwise, that are altered via photoshop/AI/hand/etc. and then disseminated
2. Images, that appear or seem to be of minors, created entirely through synthetic means (photoshop/AI/hand/etc.) and then disseminated
Can drawings be illegal?
Yes, very much so.
https://en.m.wikipedia.org/wiki/Legal_status_of_fictional_po...
Wikipedia calls the US a legal grey area but it really isn't. It's just a long road to, "yep still illegal."
For sure.
https://en.wikipedia.org/wiki/Legal_status_of_fictional_porn...
> The PROTECT Act also enacted 18 U.S.C. § 1466A into U.S. obscenity law:[122]
> Section 1466A of Title 18, United States Code, makes it illegal for any person to knowingly produce, distribute, receive, or possess with intent to transfer or distribute visual representations, such as drawings, cartoons, or paintings that appear to depict minors engaged in sexually explicit conduct and are deemed obscene.
> Thus, virtual and drawn pornographic depictions of minors may still be found illegal under U.S. federal obscenity law. The obscenity law further states in section C "It is not a required element of any offense under this section that the minor depicted actually exist."
The difficult part of this is the phrase, "...that appear to depict minors..."
So I think the default assumption for most realistic AI-generated images, is that they were generated from at least some real photographs.
I am not an expert in AI images, but perhaps there is a way for AI to be trained on real pictures of children (innocuous, clothed, etc.), combined with real images of adult porn to create novel realistic child porn.
Censorship is the mother of metaphor - J.L.Borges
P.S. Japan does appear in the long list of legal exceptions in the Wikipedia article linked by sibling comments
This is a really hard issue to tackle!
But these images do bring us some new (terrible) questions to ponder. Especially if the police can't differentiate between what's real and what's not.
This just means that efforts to find and protect real children will become harder, as those children will be mixed in with photorealistic 'fake children'.
But possession will still (and quite rightly) be illegal.
It is annoying and, frankly, it is keeping us from evolving as a species.
As on date, the state cannot force you to testify against your own interests. It is the states responsibility to ensure it finds the evidence to present to courts.
With situations like this, the chipping away of rights will begin.
How do the cops know which is real and which is fake? Make the convict tell.
The problem is a tech problem, which has to be solved by techies. Otherwise, we will land up into a quagmire of privacy and state protections eroding, or the AI technology itself will be heavily regulated / banned.
When has that ever been the way it worked? Or arguably should have worked?
The most recent example that come to mind is the European Union Chat Control, which were meant to break all e2e encryption, enforcing on-device data scanning and fingerprinting to function.
What would that accomplish? All you'll learn is that they're all fake.
Is it a crime ? Why / why not ?
Is there a victim, is there harm being done ?
Needless to say I personally find it appalling.
The inability to extract a training set from a model adds a lot of ethical ambiguity to generative images, as does the ambiguity in who’s responsible for what the models produce. I think it would be utterly ridiculous to say that someone training models with CSAM has no culpability in what it produces— only for possessing the CSAM to begin with— but I also think it would be utterly ridiculous to hold people accountable for everything their models produce, given their flexibility. What about writing a prompt that generates CSAM inadvertently? What if nobody involved intended to make CSAM but through some algorithmic shenanigans the prompt produced it? Should we legally require some amount of model testing before it’s used? Would the tester be violating the law if it failed the test, even if they reviewed every single image in the training set? Who’s responsible for deliberately poisoned models with secret key terms, or malicious data that is not CSAM but can trick the model into creating it? Would some entity like Midjourney that not only provides a model, but a complete appliance for this process be responsible for the images it produced? Does it matter if they authored the models they use? What if users can upload or train their own models? How does automation ethically affect these considerations?
Someone with legal expertise obviously would have a better grasp of these situations than I do, but I do know we’ve got a lot of growing pains en route with this technology.
As far as I know it's still OK to make images of murder and torture.
If the training data contained sexual images of consenting adults and legal images of children, many intelligent models could interpolate between the two.
To be clear, I find child sexual abuse appalling, but maybe synthetic images would keep some people "satisfied" and leave the real children alone?
Besides, if it worked like that, training on anything under copyright would have a similar effect. These models have a bigger problem if they get “tainted” by a tainted training source. (Fingers crossed they do! But I doubt it)
But "CSAM" also includes "character looks under 18" even if they look fully developed, which an AI model could do without training on actual CSAM.
Whether that makes the model illegal is a separate question. Is a LLM illegal if a clever prompt can get it to output a copyrighted poem? Is a human illegal if they can draw "CSAM"?
Decades of megacorporation propaganda have paid off, and a fair portion of gen-z/y/x is hypervigilant about use without permission, even if the use is transformative and doesn't displace the original work. Their misguided concerns will play into the hands of the politicians seeking more control.
And it will do very little to prevent the spread of AI "CSAM"[1]. What are they going to do, regulate GPUs or any AI training software?
[1] Or any of the other concerns of today, like voice cloning or mimicry of personal likeness, like what just happened with Taylor Swift. The cat's out of the bag for images; OSS voice cloning is roughly at elevenlabs' quality, and it'll be surprising if there aren't, very soon, easy-to-use interfaces for voice cloning and tts.
While one might argue there’s no immediate victim, the problem is a kind of sexual hedonistic adaption,
At Gay saunas and sex shops it’s well known that playing porn where people don’t wear condoms greatly increases the incidence of condomless sex on the site, and playing porn with condom users greatly increases condom use. There are some saunas that ONLY play porn with condom users for this reason.
I imagine these synthetic images would do the same thing. They are fueling a dangerous fire. Soon images won’t be enough and given they’re now desensitised though frequent exposure, it’s easier to make the leap to reality
If you’re a chocolate addict, having a hobby of smelling chocolate is a really dumb idea.
Obviously the powers that be will try to use this at their advantage, trying to tighten a bit control over population, such as rendering AI models illegal, except a selected blessed few (read megacorp. ones)
IMO the general response shouldn't be just trying to defend the freedom position for freedom sake, but to find viable alternative solutions that don't mine the freedom of the population.
For example... we could try to use AI to detect if the images are AI generated or not :) And police should have the means to use AI, maybe given for free by the megacorp that benefit the most from AI
So the AI images likely are as well because the training set would contain innocent child images that helped generate them.
Training data may also unknowingly contain actual child porn. If so then any naked/sex images derive partially from child porn. And many jurisdictions have "strict liability" laws...
Find one single illegal image in the training set and the entire model would be tainted. And how many may have slipped through human review? [2]
[1] https://web.archive.org/web/20201109024622/https://www.nytim...
[2] https://www.theguardian.com/technology/2023/aug/02/ai-chatbo...
Some people loved it, some others told me I'll never find a job because I'm a bad person who can't work with others (I have a job).
edit: in case that wasn't clear, it still doesn't allow child porn…
And I couldn't pick one of those that say "no skill discrimination", since that is just wrong. So since I had to write my own, might as well address the issues I've encountered.
Ok.
Can you come up with an argument next time?
We aren't the same.
edit: lol cowsay-pervert? sure buddy you're changing the world haha
Just not yours :D
I don't have a need of reassurance. I just don't care about the opinion of some moron who thinks he's clever :)
Sure… why not sort the projects by popularity and check the ones with millions of downloads instead? Maybe because you're just a sad waste of atoms :)
It sure sounds a lot like you are defending pedos here...
And what would be a pedo by US standards might be legal and fine in other countries (looking at Japan lolicon situation).
…although now I realise I have no idea how it compares to the mass burning of suspected witches in parts of europe.
Regardless, modern violence is also condemned when it happens. Unless done by the in-group, then apologists try to brush it away as necessary for some reason or another. If your point was meant to be about the latter, I'd agree, though it didn't come across like that on the first reading — those sacrifices (and indeed the in/out group difference) are the "why" in "Why would you think Mayans are any more violent than other contemporary or later civilizations?"
FYI you could have some liability of you delay.
Craziest thing you ever could have imagined and only an extremely rich tech narcissist can come up with what they did to a woman already being trafficked. They did so to secondarily traumatize me.
24/7 phone line: +1-800-843-5678
Otherwise/in addition, FBI is a good bet.
[1] - https://www.ice.gov/partnerships-centers/cyber-crimes-center