The big failure mode is they can hallucinate nonsense that isn't obviously nonsense. You have to check any facts against expert sources. At that point, you could just email an expert who can use their own LLM to whip up an answer and check the facts themselves.