For comparison, here is a look at Waymo's simulation operations: https://www.theatlantic.com/technology/archive/2017/08/insid...
He's describing, incidentally, how professional drivers drive.
Pilots of small planes do the same thing. After a while you can just feel small accelerations and change of directions without needing to check some of the instruments.
If the roads were perfect, you wouldn't necessarily want them (day to day), because it diminishes the minute vibrations that make their way up to the pedals, into the steering wheel, etc., and those things give you feedback into what the car is doing that are invaluable.
Of course, the roads aren't perfect, and most of us aren't doing high-performance driving on them, and we don't need anywhere near that degree of feel, so the benefits of driving by wire far outweigh the cons of analog driving.
Ever notice how your butt tries to move more than your hands and feet when making a sharp turn at a moderate speed turn, and how you instinctively correct for it in your seat by leaning or shifting around? Know the phrase 'Fly by the seat of my pants?' Pretty much all of that rolled into one bundle of instinctive attunement.