I think the optimists are thinking "oh, the high-level problem of image recognition and building a 3D model of the area around the car is pretty much a solved problem, great, done!" But in fact, it's all the edge cases that will kill you. What happens when it is dark and rainy and the car in front of you is black, with no license plate? What happens when the car in front of you hits something in front of them unexpectedly? What happens when the car gets a flat tire? What happens when someone doesn't look in their mirrors before changing lanes? What happens when your "there's a problem" solution (like, say, stopping or slowing down) is actually not a good solution?
I have been in all of those situations except for the black car, and the humans involved all made spectacularly poor decisions.
People who claim that self-driving cars will have failure modes far underestimate the failure modes that humans have.
Now they have permits to run around 100% humanless apparently.
[1] https://googleblog.blogspot.com/2010/10/what-were-driving-at...
In the 2004 DARPA Grand Challenge, of 21 teams entered, 15 qualified to race on the course, and none finished the 240 km course. The best result was 12km. That was off road, with no requirement to obey traffic laws or other cars to hit.
Since 2009, Google/Waymo has 5 million driverless miles under their belt.
Is it 5 years away? I don't know, but this is not the same story forever. This is iterating and improving at a breakneck pace.
The problem with predicting these curves is there's usually a confluence of factors that lead to that tipping point. When the right algorithms, hardware, and software are combined it'll be obvious in retrospect, but right now we're still fumbling around with primitive solutions.
When will there be a TPU-type device suitable for in-car use? When will there be adaptive deep-learning algorithms available that can work in the demanding real-time environment of a vehicle? When will enough testing be done that we know such a solution can work without endangering people?
It will happen, but pinning down when is very hard. You'll only know when you're close, and by then you're already flipping from impossible to inevitable.
If cars with safety drivers don't count, nearly a year ago if you move to Pheonix and get lucky [1]. They're apparently planning to launch in more cities "soon" (though I can't find a list or date) [2] and they've recently got permission to start charging passengers and intend to by the end of they year [3].
So I think "decades" is an exaggeration.
[0] https://www.theverge.com/2017/12/6/16742924/lyft-nutonomy-bo...
[1] https://www.theverge.com/2017/4/25/15415840/waymo-self-drivi...
[2] https://www.theatlantic.com/technology/archive/2018/01/waymo...
[3] https://www.digitaltrends.com/cars/waymo-now-a-full-ride-hai...
(But yeah, we are very far from cars navigating urban areas, or indeed anyplace where weather is inclement and so are people.)
Even if you have a driverless solution today it'll take years to test it and get it certified.