"Hallucinate" is just a term we've come up with for LLMs making mistakes. If the LLM knew it was making a mistake, wouldn't it just not make it?

Of course, it's not possible for an LLM to actually "know" anything in that sense of the word.