> Humans have a tolerance for human-style accidents, but not robotic-style accidents.
I think it's more because there's someone to yell at - someone to blame.
Think of it like a taxi driver with a passenger; people ride in these all the time, or uber, or lyft - and have no problems doing so. Even though they aren't in control, and they have no idea about the driver's driving capability. They assume the driver is an average to better driver, when that may not be the case at all. So what happens when an accident occurs?
Well - if the passenger is still alive, and believes it to be their driver's fault, they can yell at their driver. If they believe it's the other driver's fault, they can yell at them...and so forth.
But you put a robot in place of any driver - then who can you yell at when an accident occurs? Nobody. You can yell all you want, you can even blame the corporation that made the car/robot - but you are still yelling at a machine. It won't change anything. It won't feel bad. It probably won't even make you feel better, because it won't restore your agency in the situation.
That's my guess anyhow - pulled straight from my nether regions, with nothing to back it up. I wonder if there have been any studies on this? Are there any data on what happens in other "self-driving" incidents; like perhaps completely automated trains with no humans other than passengers on-board? Do such things even exist?
Or do companies already know this - and put a human "in charge" to take the blame and heat for when an accident happens (maybe they also provide an e-stop button for the human to press - whether it's actually connected to anything or not - but it's logged as to whether it was pressed, just to help "assign blame" later)...?
While I have no proof or anything to back this assertion or theory up, it seems like it would match human nature. When things go wrong, humans want to blame somebody - some actual, sentient being. I'm sure there's a psychological term for this need and the action; I don't know what that term is, but I'm almost certain it's been studied.
Essentially one of two things would have to be done to overcome this: Either the machine would have to become perfect at driving and avoiding accidents (even to the point of avoiding things of natural random consequence, such as rocks falling on the road, or something of that nature) - or it will have to become more sentient, and ideally emotive; that is a GAI with human traits.
The former is likely impossible - randomness will always get ya; even trains have what should be "avoidable" accidents.
The latter - well, if it's achievable; that is, if we can make such a GAI, etc - it will likely also suffer the same problems humans do, most notably that we are failable and we make mistakes.
...but at least then we can blame them on something, right?