What happens now if someone uses traditional search and comes across an outdated wiki or Confluence page with outdated/wrong/bad instructions, or interprets something incorrectly?
So the question is is the chat bot better than people trying to understand complicated government websites by themselves?
No government employee is your lawyer. If the government gives you incomplete or wrong information, you are still liable for not doing the correct thing.
Having a website that does a best guess at what steps a person must take after changing a name or getting married is better than nothing, but the status quo isn't "nothing".
It needs to be kept up-to-the-minute updated and it can't skip any nuance / details. Does anyone here really trust the lackeys who spectacularly failed at DOGE to do boring and highly detailed work?
My team experimented with this a couple of years ago with a complex government regulatory body of knowledge.
Google and Microsoft have APIs that will ground with and reference the specific policy documents, which helps. Even then, it was more useful as a job aid for people already knowledgeable of the data than for a layman.
With all LLMs, the quality of the question correlates with the quality of the answer.