There was a blog post about the problem with almost-good self-driving systems. It takes care of 95% of anything the car might encounter.

The problem is that the leftover 5% are the hard cases. When a driver is completely unengaged 95% of the time, the liklihood of (human) failure is much greater than if they were piloting the vehicle full-time.

You glide by with _when the LM(Ai) is wrong, I just move on.._ as if you were magically born with some intuitive ability to detect wrongness.

I imagine you have _experience_, prior to LM, that gives that ability. Where will that experience come from?