AI is famous for hallucinating and misunderstanding subtle points, especially when you get away from the typical stuff it is trained on.
Yes and know. The biggest problem I've experienced vis a vis hallucinations is tabular data. In prose, where context is anchored by surrounding words. Even the subtle points are conveyed appropriately.