This is why for domains like science, tools like Elicit are so needed [1].

They've been doing some interesting work on factored cognition to avoid these sort of hallucinations [2].

1: https://elicit.com/ 2: https://blog.elicit.com/factored-verification-detecting-and-...