People won't buy self-driving cars (well some will, but not the majority). These cars will be running 24/7 in a ride-sharing service.
Ever call a taxi (not in city) ? 30+ minutes.
Also, tragedy of the commons ... who was the last one to use the car has to pay for clean up.
How to accomplish that ? ... "No the other guy did it ..."