(but it isn't and won't ever be an oracle and apparently that's a challenge for human psychology.)
(but it isn't and won't ever be an oracle and apparently that's a challenge for human psychology.)
But... end users need to understand this in order to use it effectively. They need to know if the LLM system they are talking to has access to a credible search engine and is good at distinguishing reliable sources from junk.
That's advanced knowledge at the moment!
They can often reason themselves into some very stupid direction, burning all the tokens for no reason and failing to reply in the end.
Me: How do I change the language settings on YouTube?
Claude: Scroll to the bottom of the page and click the language button on the footer.
Me: YouTube pages scroll infinitely.
Claude: Sorry! Just click on the footer without scrolling, or navigate to a page where you can scroll to the bottom like a video.
(Videos pages also scroll indefinitely through comments)
Me: There is no footer, you're just making shit up
Claude: [finally uses a search engine to find the right answer]