People aren’t going to trust cars to safely do level 5 if they can’t do level 4 99.999% of the time. So sure there will be occasional stories of i95 blocked for 3 hours due to software bug, but how is that different from a major accident that occurs regularly?
An interesting experiment would be for Uber to send two cars for pickup, one human and one self driving. And let people choose.
Assuming we get to that point it will probably be another 20 years after that before non self driving is seen in the same way as driving a motorcycle is today. Aka something that’s not suicidal, but defiantly excessively dangerous.
Two final thoughts...
(1) Maybe within the next 50 years devs can instill into AI, some meaning of death. As it is, I find some comfort knowing my driver realizes the difference between a field and a 40-foot cliff along the coast of Big Sur, and our shared theory of mind regarding the consequence of swerving to avoid something in those situations.
(2) Regarding humans being more tolerant of human error. I think this might be because when a human gets in an accident, there is always the ability to reason that person is different than us: old, tired, drunk, distracted, etc. And both the situation and the cognition are unique to one person. Naturally, we would have done something different to avoid the accident, we reason. If an AI gets into an accident, and we know that same exact AI is driving 10 million cars, including our own, that freaks us out a little.
Yet aircraft autopilot fails, pilot error, and mechanical error seem to all get the same attention. That might be because the pilots are also at fault for autopilot issues, or it could be autopilot used to be really really dumb so there was a lot of stories that autopilot flying into a mountain etc to prep people with how dumb it was or it could be something else.
If that makes sense?