I also remember run-down suburbs where massive potholes and ditches make navigations of certain streets a puzzle by itself, compounded by garbage trucks ahead just doing their thing, improperly placed signage ahead, and those badly-designed intersections where you can totally count on drivers misjudging distances.
As the designers move away from the relatively trivial confines of well-maintained urban spaces and into different countries and cultures, I seriously question their ability to keep things reasonable for the rest of the human drivers. So far nothing in the near-future horizons of this technology indicates that the software would be able to navigate in many of these adverse situations without incurring huge time penalties or causing unacceptable delays.
I really do think that a lot of the hype happens to be because certain actors (Uber comes to mind as the most significant) have basically placed all their bets in these edge cases being small enough that a small number of human drivers should suffice to get around them. I remain skeptical.