Wouldn't this also hold true for airline pilots? How quickly can they resume control of a plane when something goes amiss?
If a malfunction happens during landing, you definitely don't have several minutes to rectify it.
A good analogy would be an onsite ops team optimistically has nothing to do all shift but they can respond extremely quickly when it becomes necessary, whereas if I get an emergency phone call in the middle of the night its going to be at least a minute of WTF before I can settle down and get to work.
The biggest problem I have with no way to drive the car is parking. "HAL, grannies knee is hurting her, that being the whole point of driving her to physical therapy today, I insist we park illegally at the entrance door for 5, well, 30 seconds while she gets out, then and only then we will park for real about 1000 feet away" "Thank you HAL but I don't care what google maps says, the building has been remodeled since your data was downloaded 5 years ago and the entrance is now on the other side of the building so (insert jedi wave) you will park on the other side of the building" "HAL you may not have noticed but that urban parking spot is full of broken glass bottles so you park over there instead, at least as long as I'm paying your repair bills when you pay your own bills by driving for Uber then you can pop your tires whenever you want" "Yes HAL I know we're going to store XYZ at the mall, but thats just my first stop and I want you to park at store ABC because its my last stop so I know %^&# well that google calendar says I'm going to store XYZ and if you ever want your oil changed again you will park at store ABC exactly as I tell you" "Yes HAL the loading zone is illegal to park in, but think about it for a second, I want to park in the loading zone because I'm loading new furniture into the trunk" "HAL I'm not even going to try to explain the concept of a drive thru window at my bank, you just let me navigate OK?" "HAL this is called the Concerts In The Park event because its a music concert in the park, and you will park in that grass field right where the helpful parking attendant is waving" (edited to point out that all of these situations are predictable well over a minute in advance, or will be "argued" with the car while its in Park mode)
(And edited to note that the average drunk driver is a very safe driver and drives hundreds, even thousands of times between arrests or crashes ... there exist high functioning alcoholics who basically haven't driven sober in a decade or so ... all you need to achieve is better than the average teen, perhaps, which isn't a terribly high achievement, and that may only require a small fraction of a second to get up to speed. Or during a software crash all you need to do is drive better than a crashed computer, which likely isn't very challenging even for a drunk or a teen)