Given how bad humans are at driving cars safely, it is unfortunate that we are holding self-driving cars to a higher standard than we hold humans. It will cause needless loss of life.
Not disagreeing with you just offering an opinion which is more centered and cautious.
I like to look a it from the other direction "Would I be better if everyone had a self-driven car?"
I understand that a lot of people are more concerned about control than safety (e.g. tons of people who are more afraid to fly than to drive, even though it's vastly safer), but it's a clearly irrational preference.