This is a false line of thinking. Karpathy say's hallucinating is what makes LLMs special. LLMs are way more like compression with a mix of hallucination rather than anything else.