How do you reduce errors or hallucinations? I recently uploaded a very clear PDF to meta.ai and asked it a few, very simple questions. It completely made up quotes, including page numbers, section numbers etc.
There's different ways to validate, but that's why maintaining hierarchy and metadata is so important. If you track this information properly, you can cross-check responses across different LLMs!