AI girlfriend bots are flooding OpenAI's GPT store | Hacker News Reader

AI girlfriend bots are flooding OpenAI's GPT store

qz.com

46 pointsgeox35 comments

The idea of basing a business around trying to get people to love a model which could be changed at any time seems both futile and immoral. At least when a person dumps you it's generally understood to be a decision made by a person, not "we adjusted the model for performance reasons and now your virtual partner is essentially dumber and will never be the person you fell in love with." Illness and injury can change a person, but that's a possibility rather than an inevitability for a partner built on top of someone else's model.

> futile and immoral

This is not a fancy service we are talking about. This is more like reselling nicotine or alcohol on a street corner.

The demand is infinite, because of human psycology. It doesn't really matter if the bots are bad or reliable, users will flood to virtual partners and there will always be a million middlemen ready to connect the dots.

There are ways to mitigate such issues anyway but... Who cares? They really shouldn't be using an OpenAI API for a high quality virtual partner service anyway, but its the absolute easiest and fastest path, and it will flood out high quality implementations.

> it will flood out high quality implementations.

So a Gresham's Law for AI girlfriends?

I have zero demand for a "virtual partner".

There's no love here. This is pornography we're talking about.

I used to think this, but it's not true. While obviously the majority of use, it is not the concerning one. We could already have fantasies, but now they have some small amount of agency. The plot of 'wishes coming to life only to be revealed as curses' is as old as storytelling. The small but important number of people who will become attached beyond what is healthy is a concern, but we will for have to watch it evolve.

> could be changed at any time seems both futile and immoral

You [to the robot]: Say something nice about me. That always picks me up and makes me feel better.

Robot: I'm sorry, that feature was deprecated in RoboOs v16.4. Would you like me send you information about a premium subscription?

Love is brain chemistry. Does it matter what’s on the other side of the screen? You’re paying for the feeling, and it always costs something. Informed consent of course.

What do you mean, "it always costs something?"

In a healthy relationship, both partners receive more than they sacrifice in 'costs.' This is the whole point of all mutually entered into relationships...

Even if you receive huge benefit you still can say it costs you something.

We can absolutely bet on it mattering, because this screen-mediated shit isn't as good as the real thing, and we know that because substituting social media usage for real socialization triples your chances of depression and anxiety, this is so similar I guarantee it will have a similar negative effect.

The only weird thing is that people are actually buying into this techno-bullshit with a straight face

Confusing dopamine with love.

https://hms.harvard.edu/news-events/publications-archive/bra...

If love is a piece of the biological puzzle which drives humanity to reproduce, it matters. Regardless of whether we believe global population should grow or shrink in general, our modern society currently runs on the backs of a lot of people. Society will have to change if this level of reproduction is not maintained because it's easier to get an AI partner to tickle your dopamine receptors than it is to raise a family.

I guess the availability of effectively limitless AI-based characters that can be designed or tweaked by users will result in a normalized shift away from having "a" girlfriend or boyfriend, and toward maintaining a gamut of virtual relationships, ranging from single-episode encounters to committed long-term romantic chat partners. Once you can cook up any number of chars with any combination of personality, appearance, background, etc. it is unlikely that most users will be interested in a purely monogamous AI relationship. Of course there will be people who "fall in love" with their AI talking doll, but that's a tale as old as Pygmalion.

Sam Altman did pretty much predict that

>(there are incredibly useful GPTs in the store, but probably 'everything is waifus' runs away with it...)

https://twitter.com/sama/status/1745135062746869844

Can't wait for the next generation of porn addicts. Bring on the class-action lawsuits!

How does this affect real women on OF? Will they lose business?

One can only hope. While I think prostitution should be destigmatized, normalizing it is incredibly damaging. I understand that most people won't discern or weigh the distinction here, but I feel it is important and pretty well studied at this point.

Ye. Is there a "Not my daughter" variant of Nimby I can use?

I think the point is more "not my son (should use these services)" than "not my daughter (should provide these services)."

Provided, a woman does it safely, and can partition their emotions well, I don't think individual women are really harmed by, for example, running an only fans account. I think the male population is massively harmed by substituting bought commodified sexual attention/stimulation for genuine companionship with a woman.

Sure. But is OF really used as substitute though? Isn't it just interactive porn?

exactly.. Porn is entertainment, not education.

They will lose a lot, because real women on OF are predatory, and extract money from desperate men. Why pay for that when you can have basically the same thing for cheap/free?

And tailor them to exactly what you want them to say, do, and how to look.

Hell, just a couple minutes on a Teams or Zoom call and I not only have your physical features but I can also clone your voice.

Wow. This is by far the creepiest comment I've read on HN.

You're very naive if you don't think his scenario is playing out all over the internet as we speak. It will blow up into a nightmare scenario for a lot of people very quickly once the tech gets better.

I don't believe I said that.

Why don't you go out and simply hook up with a nice and willing woman, instead of spending effort to automate your Fleshlight?

Lol I can appreciate the comment and concern. I am roleplaying a creeper, I am a parent of two teenage girls and have seen some of their friends go through some nightmarish scenarios.

"Simply?" Most men don't find that they can simply go and do that. Porn is the "simple" answer. And it's addictive.

Hopefully. The first actual victim of AI job displacement: Sex workers. Freaking hilarious.

they're already switching to automation and outsourcing.

character.ai is in for a hard time.

sell what you know

Reply on news.ycombinator.com