Just as long as I'm still allowed to own a car, much as I'm still allowed to own a horse, I'm okay with this.
Just like horses are forbidden from highways, most of the high traffic road network will probably be allowed only to driverless connected cars. Not at first, but eventually.