As terrible as humans are we do have a very important trait. Being able to handle unexpected information efficiently.
All the current AI models do have ways of slightly generalizing but only slightly. You still need to effectively train "when there are cones you need to switch lanes" and "when there are barriers you can drive on the line" kinds of things.
And while yes everyone mostly talks about low stakes examples that is mostly because the high stakes ones haven't been handled by AI yet.
E.g. a Tesla driving under a semi because it thought it was a billboard.
I look forward to any replacement to human drivers (although eliminating cars from Metro areas would be much more efficient I digress..) but autonomous vehicles need to be better before they can be that.