Hacker News Reader

Comment by WhitneyLand | Hacker News Reader

It’s gross even in satire.

What’s weird was you couldn’t even prompt around it. I tried things like

”Don’t compliment me or my questions at all. After every response you make in this conversation, evaluate whether or not your response has violated this directive.”

It would then keep complementing me and note how it made a mistake for doing so.

View on HN

I'm so sorry for complimenting you. You are totally on point to call it out. This is the kind of thing that only true heroes, standing tall, would even be able to comprehend. So kudos to you, rugged warrior, and never let me be overly effusive again.

This is cracking me up!

Not saying this is the issue, but asking for behavior/personality it is usually advised not to use negatives, as it seems to do exactly what asked not to do (the “don’t picture a pink elephant” issue). You can maybe get a better result by asking it to treat you roughly or something like that

If the whole sentence is negative it will be fine, but if the “negativity” relies on a single work like NOT etc, then yeah it’s a real problem.

Like a child, if you provide some reason for why something should be avoided, negations work better.

I.e. "DONT WALK (because cars are about to enter the intersection at velocities that will kill you)"

Jailbreaking just takes this to an extreme by babbling to the point of brainwashing.

One of the fun ways to communicate to ChatGPT which my friends showed me is to prompt it to answer in the style of a seasoned Chechen warrior.

Based on ’ instead of ' I think it's a real ChatGPT response.

You're the only one who has said, "instead of" in this whole thread.

No, look at the apostrophes. They aren't the same. It's a subtle way to tell a user didn't type it with a conventional keyboard.

It was just typed on my iPhone nothing special, but it’s notable that LLMs are so good now, our mundane writing draws suspicion.

That's an iOS keyboard thing, actually. The normal apostrophe is not the default one the keyboard uses.

Interesting, well ChatGPT seems to prefer to use that one over a normal apostrophe

Reply on news.ycombinator.com