That's probably fine though, if the automation can reliably discover when the environment changes. Especially since perhaps a majority of the time spent driving is in the very few "easy" scenarios.
Human drivers are probably happy to drive 10% of the commute time for the next 2-4 decades.
What this means however is that the dream of completely autonomous Ubers and transport trucks is probably much further out than some might hope.