Yeah, and it should not be understated how bad only having autonomous cars would be for privacy and security conscious folk.

A lot of the time you don't own them, so they're operating on the terms provided by the companies and government, even when it's directly against your own interests. The idea of a car that can't drive certain places, be used at a certain time or be used by certain people feels like a terrifying inevitability, and one which society should refuse at all costs.

If you drive your own vehicle, it goes where you want it to go. If you don't drive your own vehicle, it goes where a company or government wants it to go.