Take driving in the snow, for instance. It might be completely impossible to do it safely for the next twenty years by having a computer manage the drive path, but designs might create the ability for cars to form mini-trains where the lead car is driven by a human and the cars fall in line together. Then you could still get in a self-driving car, it could still get you from Toronto to Ottawa. It could even get you right to your front door! They'd just have to pay some train drivers (conductors?) when the weather is too harsh for to put it in full auto mode.
We're going to get there. The benefits are too obvious and we can work around the persistent problems.