Hacker News Reader

I filed a bug on BugCrowd with this issue, from the api, but it was dismissed. if you ask it to “rewrite” as the system message and no user message, it rewrites some random user’s message.

Edit: if i remember correctly it was the 16k gpt3.5 turbo model

View on HN

How do you know its a random users message and not a generated user message based on the training data?

I just replied to my original comment.

As proof, it gave me multiple rewrite answers saying that what i asked(random user’s ask) was not meeting their guidelines/safety and cannot answer.

I don't understand how this is proof. OpenAI can easily have guardrails that prevent queries asking for other users information.

Well, it's the best i got. I would expect it to hallucinate, but i would not expect it to hallucinate restricted content and then tell itself it's forbidden.

Reply on news.ycombinator.com