How do you address this problem with people? More than once a real live person has told me something that was wrong,
1. You ask someone you can trust for facts and opinions on topics, but you keep in mind that the answer might only be right in 90% of the cases. Also people tend to tell you if the are not sure.
2. For answers you need to rely on you ask people who are legally or professionally responsible if they give you wrong advice: doctors, lawyers, car mechanics, the police etc.
ChatGPT can‘t lose it‘s job if it informs you incorrectly.
I have had language models tell me it doesn't know. Usually when using a RAG-based system like Perplexity, but they can say they don't know when prompted properly.
https://danluu.com/nothing-works/
The idea that competition is effective, is often in spherical cow territory.
There’s tons of real world conditions which can easily let a firm be terrible at their core competency, and still survive.
If you had written "notaries don't even get insurance because giving bad advice is not something you can be sued for" you would be consistent.
If they lie on purpose I don’t ask them anything anymore.
The real experts give reliable answers, LLMs don’t.
The same question can yield different results.
Most people don't even know any experts personally, much less have one they could call for help on demand. Meanwhile, the unreliable, occasionally tripping pseudo-experts named GPT-4 and Claude are equally unreliably-expert in every domain of interest known to humanity, and don't mind me shoving a random 100-pages long PDF in their face in the middle of the night - they'll still happily answer within seconds, and the whole session costs me fractions of a cent, so I can ask for a second, and third, and tenth opinion, and then a meta-opinion, and then compare&contrast with search results, and they don't mind that either.
There's lots to LLMs that more than compensates for their inherent unreliability.
Most people can read original sources.
Kurzgesagt had something along the same lines: https://www.youtube.com/watch?v=bgo7rm5Maqg
(Incidentally, not that different from LLMs, once again.)
I trust some LLMs more than most people because their BS rate is much much lower than most people I know.
For my work, that is easy to verify. Just try out the code, try out the tool or read more about the scientific topic. Ask more questions around it if needed. In the end it all just works and that's an amazing accomplishment. There's no way back.
I can't do this with an LLM because it does not have identity and may make random mistakes.
LLMs also lack the ability to say "I don't know", which my fellow humans have.
You ask an actual expert.
I don’t treat any water cooler conversation as accurate. It’s for fun and socializing.
This is also not related to the problem being trivialized in the presented solution.
Lack of access to experts, doesn’t improve the quality of water cooler conversations.
Think this thread has gone from "how to Trust AI", to "how do we Trust Anything".