Given the recent legal cases where lawyers did use Chat GPT to do research and help write their brief did not go very well I'm not sold that on all the optimism that's here in the comments.
The technology is fine, the education and literacy about its flaws and limitations among typical nontechnical users is another story.
They were all idiots too cheap to pay for GPT-4. Got caught by hallucinations.
That was rookie level mistakes though. Not checking a *case* exists? Building a small pipeline of generation->validation isn't trivial, but it isn't impossible. The cases you describe seem to me like very lazy associates matched with a very poor understanding of what LLMs do.