Hacker News Reader

Comment by wokwokwok | Hacker News Reader

> Some of the characters in the novel may be downright evil and do evil things, including rape, torture, and murder. One popular example is Game of Thrones in which many unethical acts are performed. But many aligned models will refuse to help with writing such content. Consider roleplay and particularly, erotic roleplay. This is a legitimate, fair, and legal use for a model…

This was an interesting technical read, but you are doing yourself zero favours if you frame your endeavour, what ever it is, in these terms.

If you want to write that kind of stuff you can; do you really need a model to generate an endless stream of it?

Seems a bit meh frankly.

I do agree open models enable things, but… I dunno, this feels like generating 100s of images of girls with gigantic breasts using stable diffusion.

It just makes me not want to associate with this tech, or people who advocate for it.

View on HN

I think it gives him most of the favors.

Hard to argue against how popular works that have incredible violence are. Violence is an integral part of the fictional worlds authors build and our stories would be entirely different without it. Of course we want AIs that can engage with those topics.

Your quote says "help with writing" but you couch it as generating "an endless stream". Why would you frame it that way? Come on.

So true, I cannot believe how modern society has become so censorious. Being able to explore every area of life in graphic fictional detail, is part of being human, it's necessary intellectual freedom for us to grow as individuals, into better people. Because that way we confront the gremlins inside of us.

[Post deleted because I can't be bothered]

Am I reading this correctly that your suggestion is to stop writing sex and violence in fiction because it might trigger people?

Nope. My mistake for trying.

No, they are saying that a discussion about sex and violence is going to trigger a discussion about sex and violence instead of a discussion about alignment. The irony is that trying to avoid those topics resulted in a (hopefully brief) discussion about sex and violence instead of a discussion about alignment.

ETA and now it’s gone, fair enough too.

I read it as "let's not discuss sex and violence for the sake of this argument because it will get a rise from people and they will hyperfocus on that and not the general issue", and let's bring up some other example that shouldn't derail people instead, but is still the same type of problem.

>in a certain part of the world

What country's culture doesn't involve lots of violent stories? The Romance of the Three Kingdoms, The Bible, the Qur'an, the Bhagavad Gita, Norse Mythology, the Odyssey, it's hard to think of any famous work of ancient literature that doesn't involve a nontrivial amount of violence.

> I do agree open models enable things, but… I dunno, this feels like generating 100s of images of girls with gigantic breasts using stable diffusion. It just makes me not want to associate with this tech, or people who advocate for it.

Yet the same tech that is used to stream educational content is used to stream porn to the end-users household. We are at this weird stage currently, where the technology is not only a means to do something, it is also THE something. I find this highly interesting.

>I do agree open models enable things, but… I dunno, this feels like generating 100s of images of girls with gigantic breasts using stable diffusion.

Are you saying you prefer actual women be exploited to take these pictures?

>If you want to write that kind of stuff you can; do you really need a model to generate an endless stream of it?

If you want to use an LLM to do insert {x} here, you can, do you really need a model to generate an endless stream of it?

Based on internet traffic you could argue that the internet is just lewd content too, could you not?

I thought the majority of IP packets contained SMTP spam?

Most of which is lewd in nature.

> It just makes me not want to associate with this tech, or people who advocate for it.

Congrats, you just figured out why Microsoft wanted these model limitations in the first place.

Reply on news.ycombinator.com