Tesla’s ‘Full Self-Driving’ Beta Software Used on Public Roads Lacks Safeguards
consumerreports.org
consumerreports.org
https://youtu.be/GlIdu7prsAw?t=334
https://youtu.be/GlIdu7prsAw?t=164
I've skipped to spots where the car makes an error, but the whole video is worth a watch.
Here's what the Tesla recognises on the screen:
One person
Nothing
Motorcycle
Nothing
Motorcycle
Nothing
Car
Nothing
One person
Two persons
One person
One person and a motorcycle
One person
Nothing
Motorcycle
One person
One person and two motorcycles
Two persons
One person
One person and a motorcycle
Two persons
One person
It seems to me you wouldn't really need public testing yet at this early stage of development. At a minimum, I would expect it to count the people correctly and get rid of the motorcycles, i.e. basic perception.I don't know how much the system can ignore or mislabel people and still drive safely, but right now it's not really safe and it's not necessary to have the car drive while improving object recognition.
What the alpha flag would change, exactly?
https://en.wikipedia.org/wiki/Self-driving_car#SAE_Classific...
Your grandpa is one person. Retesting 100 million drivers to find the bottom 10% is not exactly very feasible. For a model of FSD, all vehicles on the road share the exact same level of performance. We are talking about scale here.
It is like comparing me selling some vegetables from my garden to a neighbor and a company selling 100 million units of vegetables across a country. It makes zero sense to say "they should both have the same level of safety standards", since a listeria outbreak sickening thousands is far worse than a tainted cucumber poisoning one neighbor.
Tens of thousands of cars using dangerously poor driving level software is worse than any one individual driver that may have dangerously poor skills.
I am also in favor of enforcing this for all foreign drivers going through my country somehow, since most of them don’t really know how to drive here.
One problem we have here (in the UK) is that unless you've committed a crime the most likely person to assess that you shouldn't drive any more is your GP (doctor). But doctors operate in an ethical framework that prioritises the interests of each patient as an individual, resolving both silly theoretical ethical problems ("Do I kill this healthy patient to save these other dying patients?") and real world practical ones. So, "grandpa's driving is bad" only meets the threshold when it's so bad he'd likely die, if he will just kill or injure other people that's not an ethical obstacle in this framework unless grandpa is uncomfortable with it, in which case he should stop driving without waiting for the license to be taken away.
This is something you're seeing in health policy right now. Sticking needles in people's arms is something medics do, but they all operate under this ethical framework. So, while a government may have good reason to vaccinate Bob, the doctor is only willing to vaccinate Bob if Bob wants to be vaccinated and it's personally in Bob's interest, regardless of whether it'd be better for everybody else.
Still, where it's important to public policy you can sidestep the ethical problem by sidestepping the medical procedure, here are two examples used today in the UK:
1. If somebody claims you're the other parent of their children and you owe child support but you disagree, the government can decide to make you get a DNA test (you get a refund if they aren't your kids). But the DNA test is a medical procedure, so if you really don't want it, the medics won't do it. Instead you'll end up in court, and the court will look at the available evidence and most likely say, well, seems to us if you were not the parent of these kids you'd have taken that DNA test and proved it. You owe child support. (Owing child support isn't a crime, so, there's no need to meet the criminal evidence standard).
2. If you're in a vehicle accident or just it seems obvious to them you might be drunk, the police can decide to test for alcohol. Some of the tests they could try don't need a medic but do need your co-operation, others would need a medic. Either way you might refuse and so, the law just provides for a penalty for "Refusing to provide a sample" that's almost exactly the same as the penalty for drink driving you might hope to avoid by doing so.
This crap should not be in control of a vehicle.
And release version HumanDrivers who kill 3000 people per day.
It seems to cope find with moderately busy streets https://www.youtube.com/watch?v=EtPGTOJ5Nks
I live in the examination territory for my region, in a country where you need to do some serious learning before you're allowed on the road in a car.
Have any FSD beta Teslas crashed?
Seriously, watch the video. Human not wanting to die is the default, but should not be a requirement for something labelled 'full self driving'.
What would be useful is to get the debug report, what it thought it was doing, what it was planning to do in the next second, would it have crashed?
It's beta, why would you expect the part where it displays stuff for humans to be perfect?
v8 showed more info, v9 is fancier, but slightly less useful visualizations for now.
If it tries to drive into someone who vanished from the screen I'm sure we'll hear about it.
Tesla has deployed this beta software to just 1000 customers who have demonstrated competence and level-headedness. The drivers are required to keep their hands on the wheel, the same as with the adaptive cruise / lane centering features available on many new cars.
Many human drivers don't care about cyclists safety: they overtake at high speed, sometimes within centimeters, and occasionally force us to change course or hit us (and don't stop to help unless we don't get up).
Yet, we don't make such drivers take an exam to check their skills/behavior because they passed one many years ago.
I'd like to know how many accidents have happened with FSD before we slow down self-driving (instead of the opinion of consumer groups who've always sided against this technology). Otherwise, we should put dangerous drivers out of the road _now_. We rarely do, even after they hit pedestrians or cyclists while texting, so I prefer we focus on improving driver assist systems and focus on actual accidents (instead of Tesla brushing against bushes).
This went nowhere, because the police was overwhelmed (that was during the gilets jaunes movement, and the police was busy going after people for destruction of public properties... priority, priority...)
Too many Tesla apologists around.
They call it FSD in the US because nobody has won a lawsuit against them yet. Doesn’t the US have customer protection agencies ?
I'm not defending the price. Personally I wouldn't pay for it.
For the record, I don't own a Tesla vehicle. I don't know anyone who owns a Tesla vehicle. I don't own TSLA stock (or any other individual stock or derivatives). I've never driven a Tesla vehicle or even sat inside any Tesla vehicle.
It's true that some people who haven't purchased a Tesla vehicle might be misinformed about FSD. But it's not fraud if they aren't customers.
I don't like the FSD name and I think Tesla should change it. But I can see how people can come to different conclusions about it. The word "full" can mean very different things depending on how you think about the word and the context of its use. The two extremes:
MAXIMALLY NARROW — "Full" self driving means the car can reliably control the vehicle perfectly in all circumstances, on all road surfaces, at all times, in all conditions. This is something that most HUMANS are incapable of, by the way. So under this definition, most humans aren't "full" drivers either.
MAXIMALLY BROAD — "Full" self driving can perform the "full" set of driving tasks, imperfectly, in certain circumstances, on some road types, only at some times, only in some conditions. Doesn't even mean it can drive in these limited situations well, only that it can drive them.
Most people would agree that a realistic definition fits somewhere between those extremes. But there's no question that FSD satisfies the maximally broad definition.
I chose my parents' most recent new car precisely because of this—a 2019 model year Subaru Forester. Not only was the active safety top notch, its chassis tuning means that it's more capable of remaining composed after swerving to avoid an obstacle. (It was also one of the few vehicles which ticked every box for them.)
Here is the comparison I relied upon for that decision. (Yes, I am Australian.)
https://www.youtube.com/watch?v=g6bOwQdCJrc
A key takeaway is that they've been running this stack in shadow mode (validating output but not controlling the car) on everyone's Tesla for quite some time. Equivalent to 1000 YEARS worth of real world driving. And from this data they've proven it is now superior to radar in all circumstances.
"Stereoscopic vision works most effectively for distances up to 18 feet. Beyond this distance, your brain starts using relative size and motion to determine depth."
Source? As far as I know, thousands of Tesla employees are in the beta but only dozens of non-Employees have been enrolled to the program and had one on one conversations with Tesla employees.
In the case of any vehicle with adaptive cruise control and lane centring features, this could be anywhere from many seconds to many minutes.
In the case of a Tesla with Autopilot engaged, no hands on the steering wheel for 30 seconds will—if there haven't been any consequences prior—result in the car turning on the hazards, slow down and then stop.
I think that's a good assumption for most human driven cars as well :)
However, imagine finding yourself in some unlikely time travel event and seeing a headline from 5 or 10 years in the future and it's talking about how a car that drives itself brushed against some bushes as the major complaint.
Normal cars are random Joe vs. random Jane, both probably poor, lawsuit is not viable. Self driving cars is everybody vs. rich company. It's worth a try.
Counterpoint: whoever can convince insurance companies that they can reduce car accidents significantly might be in a very good position to strike a nice deal with one or more insurance companies.
- "Videos of FSD beta 9 in action don’t show a system that makes driving safer or even less stressful"
- "Tesla should at the very least be monitoring drivers in real time to ensure that they’re paying attention while using new software"
They do https://www.cnbc.com/2021/05/28/tesla-starts-using-cabin-cam...
Maybe these cities could furthermore be child-free, a la GTA V, so only consenting adults are subject to these heightened risks.
I’d would Lose. My. Mind.
Has anyone sued Tesla for being hit by their self driving tech?
If you look at YouTube there are tons of sleeping Tesla drivers on the highway and I think a lot are just pranks. Once people start doing stupid stuff like this on normal roads it’s not going to be fun for the people on the receiving end.
https://www.torquenews.com/11826/elon-musk-tesla-fsd-beta-te...
I haven't seen a single one that didn't obviously look like a prank.