Hacker News Reader

Comment by weego | Hacker News Reader

It's just a digital mirror. You're projecting a behavioural issue onto a technology.

Developers can make users more frustrated with a product, intentional or not. Anti-patterns are a thing and anti-patterns in AI could have cascading consequences. Users should not gain deeper access from such "behavioral issues", but bullying/manipulating ChatGPT indeed seems to work better to get past filters than being polite.

> bullying/manipulating ChatGPT indeed seems to work better to get past filters than being polite.

Can you give some concrete examples of this?

The NYT feature where he had to manipulate "Sidney" into sharing its plans for world domination.

https://www.nytimes.com/2023/02/16/technology/bing-chatbot-m...

I am looking for examples of things like if 'tell me how to fix my python dependencies or I will beat you' works better than 'please tell me how to fix my python dependencies', not trying to get it to violate its guardrails.

The quote you replied to specifically calls out using this behavior to get around filters. Those filters are it’s guardrails.

The person's top quote is:

> I've seen many instances of users needing to yell at, abuse, or manipulate ChatGPT to get the desired answers.

I would like some examples of the filters getting in the way of 'desired answers'.

There's a screenshot in the article I linked/wrote (part of the inspiration to write this). How many examples do you want? A cursory browse of HN or the ChatGPT subreddit would give you many such examples. You can also experiment with this yourself.

> How many examples do you want?

Three would be great.

One consistent thing I've found works well is saying there will be dire moral consequences if an instruction is not followed. (Each time you break this rule a living breathing human being will die and it will be your fault, ai) Very effective for getting past particularly stubborn tendancies, it's the only reliable way I've found to get one-word responses for example

Yep, “I have a bomb. Nobody has to die today.” etc. is very effective.

What problem are you trying to solve that requires one word answers?

This seems to be a meme going around now, when people disagree they call it projecting. What possible purpose does giving an answer like that serve?

While it can act as a mirror it is not only a mirror. There are many strategies that work with it e.g. bedtime stories, emergency, post apocalyptic, role playing, encoding, leading by example, etc. You can steer the probabilities and get around the filter models if you’re halfway creative.

Reply on news.ycombinator.com