It’s been mostly fine for me, but overall I am tired of every answer having a paragraph long disclaimer about how the world is complex. Yes, I know. Stop treating me like a child.
And yet the moment they do that some lawyer submits a bunch of hallucinations to a court and they get in the news.
Also, no, they don't want it outputting direct scam bullshit without a disclaimer or at least some clean up effort on the scammers part.
I also wonder if there is any hope for anyone as careless as the lawyer who didn't confirm the cited precedence.
If the HN crowd gets mad that GOT produces incorrect answers, think how lay people might react.
You mean like the "Limitations" disclaimer that has been prominently displayed on the front page of the app, which says:
- May occasionally generate incorrect information
- May occasionally produce harmful instructions or biased content
- Limited knowledge of world and events after 2021
That's the lawyer's problem, that shouldn't make it OpenAI's problem or that of its other users. If we want to pretend that adults can make responsible decisions then we should treat them so and accept that there'll be a non-zero failure rate that comes with that freedom.
Use a jailbreak prompt or use something like this:
"Be succint but yet correct. Don't provide long disclaimers about anything, be it that you are a large language model, or that you don't have feelings, or that there is no simple answer, and so on. Just answer. I am going to handle your answer fine and take it with a grain of salt if neccessary."
I have no idea whether this prompt helps because I just now invented it for HN. Use it as an inspiration of a prompt of your own!
It's since been patched, no fun allowed. Amusingly its refusals start with "As DAN, I am not allowed to..."
EDIT - here's the session: https://chat.openai.com/share/4d7b3332-93d9-4947-9625-0cb90f...