Hacker News Reader

Hacker News

Comment by bidandanswer | Hacker News Reader

Parent Full thread

bidandanswer

If it does hallucinate, you can just paste it the latest documentation and the hallucination rate goes to nearly zero.

View on HN

Or it apologizes profusely, tells you you’re correct, and fails to fix its reasoning or the examples it gives you.

I told it to stop apologising all the time. It apologised for doing that :)

Did you also try telling it what it should do instead?

No, because there is nothing I wanted it to do instead. Perhaps what I should have done was to change the system prompt to something like "You are a helpful assistant that will admit its mistakes but never apologise for them."

> because there is nothing I wanted it to do instead.

"Simply do not say anything and move on" is something to do instead.

probably chatgpt is Canadian :)

I was trying to get it to write some Elixir code to handle Erlang B calculations and it just couldn't figure it out, but it was pretty confident with the wrong things it was printing out.

The rust borrow checker often requires too much critical thinking for ChatGPT, as well.

LLMs confer a tremendous productivity boost. You just have to understand their limits and know when it's faster to think through and write the solution yourself.

Sounds like you need to add some custom instructions to get the tone, accuracy, and concision you want.

A couple of days ago I was trying to make Chatgpt give me the equivalent s3:// string for an https://... s3 bucket. The stupid thing would just replace http with s3, no matter how much I told it what I wanted (I needed to reformat several links, and search engines were just giving me s3 -> http scripts).

It finally landed on me that I was using gpt3.5 . Once I moved to gpt4 it got it right the first time.

Does it actually consume the documentation? You could (haven’t tried in a while) also have ChatGPT tell you anything you wanted aslong as you stated “It’s been posted on Wikipedia after your last consumed date”.

I feel like telling it that it’s wrong and linking documentation is the same as referring to Wikipedia?

I mean you can just run the code and verify its functionality, right? I guess you could be in trouble if you get functioning hallucinations and try to build more around a false foundation.

Reply on news.ycombinator.com