Hacker News Reader

This is horrible idea. LLMs can't preserve factual information for 100% and never will.

Why do you think that?

There are no fundamental limitations in LLM technology that precludes it from having accurate recollection of the facts, isn't that so?

Hallucination? https://towardsdatascience.com/llm-hallucinations-ec831dcd77...

I am not an expert in LLM implementations, but I don't know if that is something that is necessarily impossible to solve.

In other words, is it an inherent theoretic limitation, or a practical one, and will be solved in time?

It is impossible for now. LLMs need external factual information to be kept in check and decrease hallucinations. That is why phind.com is a good approach for improving LLMs quality, bad is that you can't limit search results to the factual only, all related and unrelated trash found by bing and advertised for money will be topped in results.

Actually, LLMs can't store 100% accurate factual information, just as our brains can't. All NNs, whether biological or algorithmic, suffer from the same flaw - the probabilistic adjustment of neurons to each other. This is what makes it impossible for the information to be recalled with 100% accuracy.

Reply on news.ycombinator.com