Isn't the dream to be able to sit in the back seat and read a book or take a nap? The human occupant might not be aware anything's wrong until the vehicle is running out of battery or gas, or gets stuck in the sand (from the parent's experience).
There's a pass through the mountains near me that gets shut down during the winter due to snow every year. I go up there usually but don't need to go all the way through - and was surprised this year to see an official CalTrans sign saying:
"Your GPS is lying to you! The pass is closed! Turn back!"
I suppose enough people every year ignore the road closure signs and continue all the way until they get stuck... how would an autonomous vehicle know any better either?