I have heard from the police in many places that humans have the same problem, and they have it in practice:
There are places in almost every police zone where people driving misinterpret the situation almost perfectly consistently. Which means in some cases that the exact same accident keeps happening with a certain regularity, mostly just involving cars (and generally in that case nothing's done about it), but sometimes involving bikers or pedestrians and in those cases usually after a while the roads are changed so it stops happening.
So here we are:
1) there are "adversarial attacks" on the human mind, in existing road situations
2) those attacks were built into our road network, by humans, and presumably accidentally
3) they systematically lead to accidents and cause deaths, mostly people who weren't even the human misinterpreting the situation. Also, a lot of economic damage is caused.
4) we do one of two things to fix it:
a) we just accept this as a fact of life and don't care
b) we change the road situation until we purely accidentally hit one that doesn't get misinterpreted.
So how to deal with this for AI drivers ... I know ! How about the exact same way ?
AI drivers, I've been stuck behind them in MTV traffic enough to know this, are far safer than good human drivers. They far exceed the ability average human drivers. And they wipe the floor with the very best humans where it comes to patience with fellow road users.
Why do we hold them to a 100% standard ? Nobody and nothing, human or otherwise, matches up to a 100% perfect standard. A stick you use to beat a dog will not have a 100% success rate, once every 10 years or so that stick will break and maybe even injure the guy holding the stick by bouncing around, and yet somehow that is acceptable ...
We need to talk about how good drivers need to be. 100% is simply not an acceptable answer.