All of those famous quotes like 'God does not play dice' or 'Spooky action at a distance' were mocking and sardonic swipes at alternative views, alternative views which were overwhelmingly supported by evidence, and ones that eventually we came to hold as most correct. He simply believed that the universe must be deterministic and rational.
And I don't think he did anything wrong there. The quotes were sardonic, but he genuinely engaged in good faith against different views - even if it would probably have been impossible to sway him from his own. And that's okay - people can see the world in different ways. And while evidence must be weighted, it need not dictate one's views.
In general I think if people were more regularly challenged on their claims, it might help reign in some of the self radicalization, intolerance, and so forth that's growing in society. When somebody only acknowledges 'friendly' voices, you end up in a scenario where they're effectively surrounding themselves with a baseline that's heavily biased, but that baseline will (from their perspective) be normal. That's just not healthy.