Humans are such terrible drivers. Most of them don't want to drive. They want to get a private chamber to wheel them around while they look at their phones.
I'm continually shocked that people criticize autonomous vehicles along these lines... like where do you live in the US that gives you such a high opinion of human drivers? Daily dipshit human driving behaviors and a frequent cadence of bad accidents or fatalities seems the norm across major metro areas.
If more robots can drive we can actually have a hard test to pass for driving. Right now basically anyone can drive because it is too expensive to tolerate it being any different given the extent with which transportation and the economy in America is built around cars. The only people who will manually drive are people that really want to. Which is how it should be. You shouldn't be operating a vehicle if all you really want is just to appear x miles away while being able to dick around on your phone or fall asleep or whatever is causing all the lazy driving behaviors we all see around us everyday.
Why over-index on a handful of autonomous driving related fatalities? How many humans kill other humans in cars? Do we ban all cars? Why do you think robot cars will necessarily always be worse drivers than human ones?