“Oh Jeeeesus”: Drivers react to Tesla’s full self-driving beta release
arstechnica.com
arstechnica.com
Considering this feature is out for anyone to use, my question is: who is responsible for the damage? Suppose you have a video like this one clearly showing autopilot being at fault, will Tesla cover the costs of damage? (of both the tesla car and the other party's car?)
The longer term answer is probably going to be "AI insurance". The bigger question is whether it will be the vendors or the owners who pay the premiums. My hope is that the onus would be on vendors, since it's their software, but my gut says that the cost will instead fall upon either owners or the taxpayer.
Uber, Waymo, etc have to pay people Tesla owners do it for free! Millions of miles...
The AP's learning curve is unknown, we don't train it to any specific standard, we don't expect it to pass any test to validate it can or should be allowed to "drive" on a public road, and the AP's "right" to drive is neither officially given, nor withdrawn after making repeated, serious mistakes. Keep in mind that the AP is "the same driver" across all cars.
Your "argument" has no merit.
Major rule of functional safety analysis: Look for common-mode failure mechanisms. If the same fault can suddenly manifest in many units, that undermines one level of "random failure" statistics.
And as a comment on Ars pointed out: these are self-reported videos, so a dozen near-accidents in three hours of videos sets a floor on how bad the driving could be.
And that's not a floor on how inadequate the system is, it's a ceiling on how much risk the drivers are willing to take. Right now most drivers do not explore further and anyway never let the whole situation unfold. Those almost crashes in the most basic of driving conditions are where the humans draw the line because they now know that's the upper limit of what it can do, the lower is facing real traffic or less supervision.
The AP gets a free pass because we want to let the technology evolve but unless we treat its "driver's license" like we do a human driver's, then the only option is to never allow more than a few seconds of "hands off wheel" on the road. Allowing the human to completely disconnect should be illegal.
We don't allow manufacturers to put a switch that disconnects the pollution control devices because "the driver is responsible for this". We should at least try to technologically prevent the driver from not driving because a system with a fancy name will. And Tesla is doing the absolute minimum there to get better stats and leave the impression the car drives itself. Every car drives itself straight to the crash site.
But in countries like the USA, India, Perú, I think the AI is the safer option.
Even a student driver is capable of navigating more complex traffic than the AP after just a few days or weeks of practicing. And at the end of that practice is a test that the AP would fail. After so many years the "FSD" AP still barely manages the most basic of driving feats, expected from a human before they get the driver's license.