Safe vs Unsafe isn’t as simple as who gets a 10/10 on the closed course test. Humans are more predictable than random chance would allow, and often even when drunk or distracted. I can’t count how many times I’ve seen someone wobbling on the road and knew to stay back. You can also often tell when someone might yank over into your lane based on them flying up in the other lane, getting just in front of you in that lane then wiggling a bit, clearly waiting for the first chance to pull in front of you and take off. There are lots of other little ‘tells’ that, if you’re a defensive driver, have avoided countless accidents.
Being a prudent defensive driver goes out the window when the perfect speed limit adhering driver next to you goes to straight to -NaN when someone drives past it with Christmas lights on their car, or the sun glares off oversized chrome rims, or an odd shaped vehicle doesn’t match “vehicle” in the database, or, or, or.
* I’m very much not saying that the example I mentioned above is reason enough, I’m saying that I’m not sure enough thought is being put into how many more pages I could go on, and I’m just some schmuck that worked for some number of years on the underlying technology - not the guy watching it fail in imaginative ways on the road.
Something said earlier that really overestimated what’s happening: it doesn’t get smarter, it gets another “if” statement.