Most humans are extremely aware of the difference between dreams and reality. If LLMs had similar awareness when they hallucinated there wouldn't be a problem.

Yeah good point. But dreams are easily distinguishable from reality.

Religion is often indistinguishable from truth and reality to those who hallucinate it.