Outrage as X's Grok morphs photos of women, children into explicit content

cnbctv18.com

59 points·anonymousab··9 comments

I came across this the other day. If you go to the photos tab on the @grom account, it’s an endless stream of women in bikinis or in explicit poses.

Apparently all anyone has to do is reply to any photo anyone posted of themselves, is something like “@grok put her in a bikini” — or more obscene demands, and it just spits out the image. It’s kind of disturbing how simple it is

Couldn’t that be a theft of someone’s photo or art? Or does X give themselves rights to all that?

Almost everywhere that accepts user generated content has T&C along the lines of "you grant us a perpetual license to use, store, transform, and share whatever you post" just so make sure nobody sues for the normal boring use of showing it to other people.

That phrasing probably covers this use, too.

Is there one of Elon Musk?

My guess is that he is protected in several ways by post-training.

It is rampant, even for minors. A huge number of middle and high school girls are getting harassed by classmates with nonconsenting porn made of them. The AI tools are nonconsenting porn machines as one of their primary use cases.

Just googling around, it's worse than I could have imagined. For a few bucks/image you can make your own videos with pre-baked prompts or even custom prompts.

At a few bucks/image they must be making bank. This is probably a huge industry.

My kids have to grow up in this world

I had never heard of CNBC TV 18, and thought this was a sketchy domain, but it turns out to be legitimate (https://en.wikipedia.org/wiki/CNBC_TV18).

Unfortunately it's a) a holiday for most news orgs and b) about an issue which will likely require a lawyer read for most news orgs before they pub.

Reply on news.ycombinator.com