The scenario is a customer opens a chat box on your website and asks some questions for the LLM.

You wouldn't expect your customers to search your internal Confluence pages. The LLM would be trained on all of your internal documentation which is not exposed publicly.

Hallucination is mostly a problem with insufficient training with the current generation of LLMs.

Edit: Maybe not "all" of your internal docs should be exposed via LLM. But the idea is this is an interactive support agent for customers.