Using the term "Hallucination" makes it sound less problematic, less impactfull for user.
They should have used the term "error". For example in statistics, there many kinds of errors, discretization error, prediction error, sampling error, ...
They should have used the term "error". For example in statistics, there many kinds of errors, discretization error, prediction error, sampling error, ...
This is more or less how I see the LLM output, but as a path finding exercise over next-token probability graphs. This is (i.e.) why they are trained to use phrases like "wait but" or "actually", these words even out the probability of different paths, giving them their ability to "consider" different solutions.