That won't happen till General AI. How would you do something as simple as drive the car onto a lift to change the oil without pedals and a steering wheel?
Or there is a concert and you need to drive onto the grass to park?
People talk as if there's some infinite number of unique edge cases when driving a dang car, but there simply isn't that much you actually do with a vehicle. Real deal no-drivers-license-required automated vehicles are coming pretty soon; maybe not in 5 years, but definitely within 20.
We are in a completely different situation today.
In other words, now you need a hi-res, current map to show. Where does the data for that come from? (Oh wait, don't tell me: Magic!)
TL;DR: "remote control" != "self-driving"
Come to think about it - even 'just park somewhere' is remarkably complicated. I don't quite understand why self-driving cars should need external high quality maps and can't make do with onboard cameras as human drivers do.
But then the parking requires either a high-quality database of valid and off-limits parking locations, or the ability of the car to read the signs on parking lots and generally be able to distinguish private from public parking.
The only thing I can think that would sell me on the idea is a really low price point, e.g. sub-$10k to get a new, driverless, road-only vehicle. But I would only want that in addition to a "real" car.
There will be an app for that?
Hey, James Bond was driving from the backseat with a Nokia 9000 (?) a few movies ago.