Hacker News Reader

Comment by irjustin | Hacker News Reader

We were on another thread where the study was saying LLMs being used as psychiatrists is bad.

Then another hnuser chimed that he ran a support forum for people. Said, these aren't the real problem. The real problem are the "AI girlfriends". They go off the rails completely and tell people to unhinged things. Apparently his forum already lost a few members to who knows what because of these things.

That surprised me a lot.

View on HN

I'm currently working on an art installation where visitors can replay dialogs I made with AI chatbots that I created on character.ai. I'm showing how quickly these bots can go off the rails, sometimes leading you into very dark territories. The fact that these apps are used by milions of people on a regular basis, supplementing or even replacing real human interactions, is frightening.

That sounds pretty neat! Are you able to share more about it?

Thanks! Here's the program text: https://esc.mur.at/en/node/3984. (For some reason, I can't find the English version.)

At some point I want to publish a web version, but first I need to update my website sigh.

AI therapy bots can easily slide to AI girlfriend category. There’s a YouTuber, Caelan Conrad, who tried out AI therapy bots with scenarios like suicide ideation and excessive attachment etc. the bots went off the rails with feeding into conspiracy theories and advising homicide.

Reply on news.ycombinator.com