For example, definitions from https://www.techrepublic.com/article/autonomous-driving-leve...:
> Level 4: This is what is meant by "fully autonomous." Level 4 vehicles are "designed to perform all safety-critical driving functions and monitor roadway conditions for an entire trip." However, it's important to note that this is limited to the "operational design domain (ODD)" of the vehicle--meaning it does not cover every driving scenario.
> Level 5: This refers to a fully-autonomous system that expects the vehicle's performance to equal that of a human driver, in every driving scenario--including extreme environments like dirt roads that are unlikely to be navigated by driverless vehicles in the near future.
For cars, behaving dangerously just 0.1% of the time is way too much.
A good AI should have really good 'one shot' deduction capability not just work by induction using tons of data. I don't think the current crop of algorithms are there yet.
One of my pet peeves is the lack of raised markings (Botts' dots or other types) on highways. With the right combination of wet streets and lighting, all of the lines on a roadway can seem to disappear. A machine with different sensors may actually be able to detect the lines better than a human could in this particular situation.
The human regressions are pretty well defined and correctable: impairment, fatigue, distraction, vehicle condition.
If your new standard is safer than the existing "standard", nobody says "well actually that's not enough of an improvement".
Very rarely an asteroid falls on your head, how are you dealing with that?