I can definitely see people becoming overly trusting of LLM output, but I have a feeling it might be a self-correcting problem over time.

Initially when working with an LLM if you start with a problem it knows well, it's likely to give good results and if some minor hallucination creeps it you may well not notice and accept it based on earlier results being right.

However it's quite likely you'll hit a wildly wrong statement at some point, and that tends to break the illusion, and hopefully people who have that experience will start being more skeptical of what they're being told by LLMs.