Hallucination is an interesting problem for both LLMs and people. This is why we like syntax and unit tests. I think there may be ways to work around it.