Besides, people are using LLMs for exactly that for ages (including Claude and ChatGPT), so the only difference is that the non-NSFW behaviour will be better (less crippled).
Win/win. No? Why?
That's the idea. For too long people have been able to free-associate and share truth online. Now they finally have a reason to end anonymity online. Due to the raw power of AI there is a very real threat these new tools provide to bad actors in the generation of misinformation and disinformation and now we need to ascertain the providence of all content created online. With "AI" being injected into every site, app, and OS we will be forced to associate real world ID's to any and all actions int he digital realm in order to "protect" the public from the wave of fabricated reality they will create.
Of course these tools will be used by those that control the moderation systems to craft and shape global negative on a scale we have never seen before. A new kind of Dark ages are here. Not one where dusty tomes are changed to the monastery walls, no, our books write and rewrite themselves in real time as needed until every thought is controlled by the over-mind.
And I saw one of his heads as it were wounded to death; and his deadly wound was healed: and all the world wondered after the beast.
-----TINFOIL HAT BLOCK END-----
Google will happily return NSFW results, without age verification.
Google will approve ad campaigns for adult websites.
Amazon will happily sell you NSFW books and tools. etc.
But OpenAI should reject prompts that result in adult content?
Then they show us what they have been working on and it is…
Robot sex chats.
They’d like another 400 billion please. They’re doing the Lord’s work here. They need to burn the planet; the competition would do it if they didn’t! This thing could turn into the antichrist any day now.
Hey! How old are you!?
First, mental health issues surrounding this are far from being solved. Having a sycophantic robot faking intimacy looks manipulative, ripe for exploitation, and damaging to long term psychological well-being.
Second, this is a service that manufactures compromising chat logs and stores them for profit. Yeah, what could possibly go wrong?
In this particular case though I can't imagine it's a good idea to hand Sam Altman and his company chat logs of your explicit fantasies tied to your real identity.
Why presume that? "Are you over 18?" is the age verification method used by 99% of the web.
OAI ultimately still makes a ton of money, and gets to wash their hands of much of the liability. It's a win-win.