I think globally we've very quickly hit LLM limits because they were simply not trained on as much information as we think. Or at least, not nearly as much region-specific information in many countries.
I've hit the same issues trying to ask any LLM to give me tax advice for tax law in specific countries, and even beyond the "ask a professional" type restrictions eg OpenAI has, it's clear that it just does not have the information.
Sometimes that's just because of the US-centric view of these companies training the models, and sometimes it's also because information sources are tucked away on botched government Wordpress sites and random PDFs.
This is why you have to do things like RAG to make a "talk to your doc" kind of bot even if you're feeding it public info.