$365B in value is probably a serious undercall. The only reason to complain here is if only $100B has been put in to the venture so far.
$365B in value is probably a serious undercall. The only reason to complain here is if only $100B has been put in to the venture so far.
However, there will inevitably be conditions that require the use of general intelligence (rather than driving heuristics), and in those situations all you can do is pray the computer acts rationally despite not having GI.
I think self driving cars have already passed the test of "number of crashes" or "number of fatalities" per mile driven. But I don't think that's enough to sway the public, if every once in a billion miles a self driving car slowly drives off a cliff for no apparent reason.
High drips the problem drops from near AGI to not outrunning the cars ability to stop without hitting anything.
This is not definitively known. The distribution of conditions under which self driving cars operate is very different from the distribution of human driving. Self driving car miles are disproportionately on the highway, with little traffic, in perfect weather (i.e. by far the safest driving conditions). In addition, we don’t know how many disengagements (or remote interventions) would have resulted in an accident.
People aren’t going to trust cars to safely do level 5 if they can’t do level 4 99.999% of the time. So sure there will be occasional stories of i95 blocked for 3 hours due to software bug, but how is that different from a major accident that occurs regularly?
An interesting experiment would be for Uber to send two cars for pickup, one human and one self driving. And let people choose.
Assuming we get to that point it will probably be another 20 years after that before non self driving is seen in the same way as driving a motorcycle is today. Aka something that’s not suicidal, but defiantly excessively dangerous.
Two final thoughts...
(1) Maybe within the next 50 years devs can instill into AI, some meaning of death. As it is, I find some comfort knowing my driver realizes the difference between a field and a 40-foot cliff along the coast of Big Sur, and our shared theory of mind regarding the consequence of swerving to avoid something in those situations.
(2) Regarding humans being more tolerant of human error. I think this might be because when a human gets in an accident, there is always the ability to reason that person is different than us: old, tired, drunk, distracted, etc. And both the situation and the cognition are unique to one person. Naturally, we would have done something different to avoid the accident, we reason. If an AI gets into an accident, and we know that same exact AI is driving 10 million cars, including our own, that freaks us out a little.
Yet aircraft autopilot fails, pilot error, and mechanical error seem to all get the same attention. That might be because the pilots are also at fault for autopilot issues, or it could be autopilot used to be really really dumb so there was a lot of stories that autopilot flying into a mountain etc to prep people with how dumb it was or it could be something else.
If that makes sense?
What is that evidence, exactly? I agree that we might eventually get there, but the scale seems to be 50-100 years at this point. We are as arrogant as the researchers in the 60s who famously announced that absolutely perfect image recognition is only 1-2 years away - except the problem is several orders of magnitude harder.
I'd judge self driving to be slightly subhuman right now - there are definitely worse drivers on the road (typically impaired - drunk, near-blind or high). I'd expect superhuman performance this decade just based on that and the rate of improvement in anything AI related right now.