It's definitely missing a "module" that humans have: something like an ability to know & admit when it's not certain about something. The way I think of it is: imagine if you constitutionally unable to ever admit that you didn't know something and you were forced to continue talking about that topic. You too would have no choice in this situation but to start spouting nonsense. Once we add this model of uncertainty, I think this type of problem will go away and it will say something like "I'm not sure but ...".