Humans have a lot of shortcomings--emotions, sleepiness, distraction, the effects of drugs and alcohol--but humans have some amazing strengths too. We've got cognitive abilities in recognizing patterns and making decisions that were honed by millions of years of evolution, and directly trained by, on average, decades of actually driving cars. I think it's easy for technology-minded folks to overestimate the impact of the weaknesses, and underestimate the deep complexity of the strengths.
We barely have fully-autonomous self-flying planes today, and I don't know of any research showing that they are safer than human-piloted planes. And flying is a far less complicated domain to automate than driving.