One can learn to drive defensively, and be able to spot the said dipshit in advance, decreasing the likelihood of collision.
Yes, not in all cases, but there's a bell curve. As humans, we can read other humans.
Robots aren't inherently bad either. I love my Roomba precisely because if it fails, it fails predictably. I can and do make my apartment Roomba-friendly.
But the self-driving deep learning-driven cars don't have this feature. They fail unpredictabily, as in your example. We don't have an understanding of what really drives the decision-making there. And we keep discovering failure modes as they manifest.
One day, the car might think the river is a road. Another, it will not recognize a road block as such. But only if it's a Tuesday. Or something. We really don't know.
So I don't think we'll get acclimated to that. Unpredictable failure is a reasonable thing to be afraid of.