Hallucinations and output quality are two different problems. Hallucinations are usually expressed in perfect sounding sentences by the LLM, that's what makes it so convincing to end users.