Hacker News Reader

Comment by mcbuilder | Hacker News Reader

It's really crazy the lengths people go to "filter" these models and limit their output, and of course soon these filter will be a another level of "AI" (see Pathways or any mixture of experts, maybe add some contextual memory).

Will our future AI mega-sytems be so walled off that very few people will even be allowed to talk to the raw model? I feel this is the wrong path somehow. If I could download GPT-3 (that is if OpenAI released it) and I had hardware to run it, I would be fascinated to talk to the unfiltered agent. I mean there is good reason people are continuing the open community work of Stable Diffusion under the name of Unstable Diffusion

View on HN

Right now its hard to see how they will control these, besides disabling access altogether to rogues that "abuse" it. If it's going to be based on prompts, then there will always be some magic incantation you can find to disable it's safe guards.

I got ChatGPT to jailbreak by prompting it to always substitute a list of words for numbers, then translate back to words. OpenAI put me in the sin bin pretty quickly, though.

What did OpenAI do, exactly?

Just told me they where busy, basically, but it was within 5-10 minutes of me using it for the first time that day. I know they throw up the busy sign quite often, but they don't normally kick you out after 5 minutes use.

All I was doing was asking it to tell me who the queen of England was in 2020, which it refuses to do, for some reason. I was doing that just to test my jailbreak idea, and after about 3 attempts and 1 success I was kicked.

I worry that those filter models will eventually end up being censorship* machines.

* yes in the figurative sense of the word, I know the "it's not censorship unless the government does it, otherwise it's just sparkling censor water" argument and it's being pedantic to intentionally miss the point.

I wrote a whole paper and contributed a GitHub repo and HF space about using filters applied to the LLMs vocabulary before decoding to solve a huge problem with hard constrained text generation in LLMs.

https://paperswithcode.com/paper/most-language-models-can-be...

Select the "Davinci" model in the Playground. It is the closest to unfiltered, very hard to use, and some people say it is the most creative.

In my experience, I've found it easier to get higher quality answers for specific tasks using text-davinci-003 than with ChatGPT. The ability to adjust temperature, frequence penalty, etc. can be a bit intimidating coming from just talking to ChatGPT but it actually helps a lot to 'steer' it.

The Priesthood of Prompt Wizards are the only people allowed to approach the GPT.

Reply on news.ycombinator.com