Tesla Autopilot system was on during fatal California crash, more safety concern
washingtonpost.com
washingtonpost.com
Perhaps the Washington Post should update their article? I know it's late on a Friday on the East Coast, but the truth is slow to get its pants on.
That "four hours to put out flames" is a bit of a stretch according to some of the reporting that came out later[1]. The fire was mostly out in about 10 minutes, but they had to keep pouring water on it until they could move the car and spray water more directly on the battery. This seems like sloppy/overly sensational reporting by the Washington Post.
[1] https://www.caranddriver.com/news/a36189237/tesla-model-s-fi...
edit: to be clear, I think Tesla deserves lots of criticism for autopilot failures that result in deaths; I just think the article is stating something as fact that's debatable.
Certainty there are non-AP accidents? There certainly could be less deaths, but for how many miles driven?
I'm not defending Tesla, or AI. This is a simple and basic statistics question.
tl;dr - driving with AP on is very slightly less safe than driving with it on, probably by a statistically insignificant amount. It’s certainly not safer.
What is odd is that modern Tesla (3, Y) vehicles have a better sensor suite than most other vehicles, and yet its AEB (Automatic Emergency Breaking) in isolation is seemingly worse than some other modern vehicles.
I can tell you for a fact that Subaru's relatively primitive Eye Sight system based on two optical cameras in parallax (like the human eye, thus the name) will "see" the depth ahead and brake accordingly, it doesn't get confused by a bridges/road signs and reflective stationary vehicles. I've seen it do so frequently.
A Tesla has significantly more sensors and more processing power but these problems continue. Everyone always gets distracted talking about Autopilot this and Autopilot that, but let's not, let's talk only about AEB and why Tesla is somehow both the best at advanced automatic driving and also somehow has uncompetitive AEB?
Maybe it is time to take AEB out of Autopilot and make it its own system that is simpler but can also react to potential Autopilot errors? Or buy AEB off the shelf and put it side-by-side with Autopilot?
[0] https://www.wired.com/story/tesla-autopilot-why-crash-radar/
[1] https://www.wptv.com/news/region-s-palm-beach-county/serious...
[2] https://en.wikipedia.org/wiki/Tesla_Autopilot#Mountain_View,...
I am assuming a simple modern lidar and software package with a field of view limited to "What can the car hit if it keeps going straight" and connected to the AEB would be a pretty fool-proof way of stopping this but that might be too much cost for too limited an application.
Though those have had their problems too. Obviously easier for them to detect other vehicles but harder for pedestrians.
For example, this would explain why Autopark sucks and hasn't improved in years.
I just looked up the subaru system. In the emergency braking case, they clearly claim that their system acts only if the driver has failed to brake. That means, for example, that it will brake much more abruptly than a human would, since it is waiting for the last moment before braking. Their lane following technology behaves similarly. Tellingly, it is called "eyesight", suggesting it is merely an extra pair of eyes, rather than "autopilot", which suggests that it can drive on its own.
Just to add another: I wonder if Tesla's driver assistance systems has been designed to minimise false-positives in comparison with those of other manufacturers. When driving a friend's Subaru on a road trip a while ago we all commented on the lane-keeping alarm being overzealous, and ended up disabling it altogether to shut it up (this is on somewhat narrow b-roads). I've read of similar complaints from automotive journalists regarding various other manufacturers. In comparison, I've barely ever experienced false positives from the model 3's lane-keeping assist, even on similar roads -- maybe once or twice ever.
Minimising false-positives is important for system efficacy, as otherwise people will simply disable it. But I do wonder if this comes at the expense of increasing the chance for false-negatives, which are far more dangerous. Is trading 100 false alarms for a single missed obstacle worth it? I'm not sure.
Also the street sweeper incident [1], the overturned truck incident [2] ...
There's a pattern here.
On top of that, they have to discard all of the radar data from objects moving at zero speed, because otherwise they’d be swamped out by the return from the road itself. So, the car has a literal blind spot for stationary objects in its path on the highway, unless it can recognize the object as a car with its cameras.
Fo years? Article says 4 deaths. If they "have been killing people for years" one would assume you'd see higher numbers?
https://www.autoinsurance.org/which-auto-makes-get-in-the-mo...
It's no surprise that the makes with the most sales and most vehicles registered and almost certainly most miles driven also have the most fatal collisions.
I bet DeLorean has zero fatal collissions for most of the last ten years. Doesn't make it a good or safe car, just means the founder got caught (set up?) on drug charges and the company collapsed and there's not too many on the road.
2020 fatal crashes:
#1 – Ford 21,262
#2 – Chevrolet 20,435
#3 – Toyota 12,918
#4 – Honda 10,969
#5 – Dodge 7,983
#6 – Nissan 7,956
#7 – GMC 4,533
#8 – Jeep 4,138
#9 – Hyundai 3,766
#10 – Kia 2,834
...
#41 – Tesla 62
2019 sales [1]: #1 – General Motors 2,886,904
#2 – Ford Motor Co 2,406,188
#3 – Toyota Motors 2,383,304
#4 – FCA US (Fiat, Chrysler, etc) 2,203,663
#5 – American Honda 1,608,170
#6 – Nissan-Mitsubishi 1,466,727
#7 – Hyundai-Kia 1,325,342
...
#13 - Tesla 192,250
also, the crashes is all model years so it favors less US market time.[1] https://carsalesbase.com/us-car-sales-analysis-2019-brands/
Tesla: 0.0322% (or 1 in about 3100 cars sold)
Ford: 0.8836% (or 1 in about 114 cars sold)
Its late for me, so check my math, but I think it’s right.
My understanding is fatal crashes are biased towards older models as well. Tesla has barely any cars over 10 years old, let alone 20 or 40 or 50.
More fair would be to look up registered vehicles by make and compare to fatal collisions (which I can't find a free source for, unfortunately).
It is a lower bound on the number of fatal accidents involving a Tesla.
Stories like this drive home the point: you can’t train your machine learning for every eventuality. Mimicking intelligence isn’t intelligence and the difference is demonstrated by the kinds of mistakes made.
The one thing I could see insurances worry about is correlated risk. Imagine if an accidental push installs a bad development version of the autopilot on all cars instead of the 2 test vehicles with extra sensors, causing a much higher crash rate. Add a broken auto-update mechanism preventing a rollback, and it could take a day to mitigate and a week to fully stop the crashes, and during that time a lot of cars could crash. As long as it's no worse than the crashes resulting from e.g. a day with severe weather, it'll probably be fine, but if it significantly exceeds that, insuring self-driving cars could become too unpredictable, and thus too risky for insurance companies.
The Tesla press releases? It's the kind of uncritical analysis that you would expect from a company trying to market something.
Food for thought: By considering only automated and mnual driving you exclude basically all possibilities. Hybrid systems that are designed around the limitations of humans and machines seem to be a much more promising but less flashy solution if safety is the goal. This approach has a long history if you consider things like ABS and the traffic fatality statistics suggest it actually works. (Crash mitigation technologies surely muddy the waters.)
> By considering only automated and mnual driving you exclude basically all possibilities.
I'm not comparing Autopilot to some hypothetical future system. I'm trying to determine whether the risk from Autopilot is comparable to human drivers as they drive now, because insurance companies have clearly shown that this is something they're willing to put up with.
A computer making mistakes isn’t acceptable, every instance will be seen as a liability and a huge one.
computers will not be given the benefit of the doubt that humans have
[citation needed]
Insurance companies will just look at the stats. And you better believe they'll jack up your rates if your self driving car crashes. You'll be held responsible, like it or not.
Overturned truck or stationary emergency vehicle should be pretty high on the list; trees maybe a bit lower. But the sensor package doesn't do those well, so in the interest of comfort, stationary objects are filtered out before avoidance algorithms are run.
Not having sensors that see trees without reducing comfort is a choice.
If the car can’t drive safely in a situation, it needs to require a driver.
Running into stationary objects has a pretty adverse effect on comfort.
I much prefer to drive a vehicle where I'm clearly responsible, but the (on by default) assistance features might help me out from time to time if I screw up. A computer doesn't get bored of checking if there's a slowing vehicle or (if it checks for them) stationary object in the path; but I'm pretty sure I wouldn't stay alert enough to jump in. OTOH, I also don't like using cruise control either, but that's not because I want to stay alert, but because without radar cruise control it's too much work to use, and I don't like the following distance options for the radar cruise control I have access to.
This wasn't some crazy edge case. The Tesla hit a large stationary object that was directly in front of it.
The only thing it drives home is that Tesla's self-driving functionality does not relieve the driver from having to pay attention.
It may be undesirable self-driving, but it does drive itself.
The marketing name is unfortunate, and leads to endless confusion in the media and the public.
Edit: why the downvotes? I drive a Tesla, I use the system responsibly and nothing I've said is untrue.
Edit: OK, there is such a thing. I guess this is why I never played the truenamer class. Point still stands.
Did you say false advertising?
Well, yeah, but I have a feeling that “I’m feeling lucky” wouldn’t be as effective a marketing name, even if it was a less confusing one.
Also, Google might get mad.
But that’s not how Tesla likes to market autopilot …
How does this stuff pass QA? And worse, how do the regulators look away? How many more will it take before an intervention happens?
To sell a higher level autonomous system, which today is only available in very limited trials e.g. Waymo, you have to collect massive amounts of safety data and submit to each state for approval.
Now, back to Tesla - NHTSA is definitely watching them with interest, and if the data show that Tesla’s marketing is inducing people to not pay attention and have accidents, they will take action.
you can put archive.is/https://anything.com to get or capture an archive!
Fucking cloudflare.
People who want to stop Tesla from continuing on the basis of this crash might not understand how software is developed.
Most software, even in places adhering to the least validation and testing-heavy agile processes, isn’t developed in a “move fast and murder people with defective products” approach.