I wonder if your insurance company will feel the same about your enjoyment, once the technology threshold is crossed well enough and they realize that automated driving is the new rail.

Or, would you be willing to pay higher premiums or even extra tolls and taxes in order to drive yourself?

I think this will eventually be a question that fails over into economics while people are arguing about it. Insurers will be in a good place to influence the future of automated driving.

Humans as a group can't even not drive drunk, still. Individuals are not predictable either. Our taste for control will have to be worked around. (Hopefully in ways that allow us more time to...for example drive in VR, on a better course, with an even more stimulating feeling of presence, while we are driven around...)