Tesla's 'Full Self-Driving Capability' Falls Short of Its Name
consumerreports.org
consumerreports.org
You need a mass amount of data to train on. How do you get that? Its an engineering or a business problem, depending how how you look at it - how do you get a ton of people driving for you?
Tesla has the better business model here. That leads to more data, which is the most important factor in training.
Now, google is orders of magnitude bigger and had a huge head start, perhaps they brute force their way to the lead. But being more conservative != better engineering. You could philosophically disagree with many things Tesla is doing, but in terms of solving self driving cars I think they have the better strategy that gives their engineers the data they need.
Tesla is in the real world recording every car they sell through vastly more dynamic scenario/terrain. That’s smart engineering.
It might be possible to handle steering, navigation, obstacle and accident avoidance purely with non-ML approaches. Then ML could be left to less safety critical features such as predicting the types of obstacles surrounding it, and their likely next moves. LIDAR (gasp!) might even help make the problem much easier.
So no, I don't think that just saying you have more data is the end of the story. It's certainly AN approach, and maybe a good one, but I don't think you can conclude their engineering is better because of it.
Tesla wins got having the most data about driving in the Bay Area. And not so much for driving anywhere else, or in bad weather, or on bad roads, or on highways where trucks may cross both lanes of traffic.
Isn't being conservative better when your technology can kill people?
If we are talking an eventual 10% reduction waiting just 1 year costs ~130,000 lives. On the other hand if mistakes slows long term adoption that’s also harmful.
PS: Adoption curves etc are also import, but that’s what I mean by mistakes slowing adoption.
And yet there is no evidence of these assertions other than wishful thinking.
There is no evidence that self-driving systems are safer than humans, so there is no reason to treat them as if they are. In fact, compared to other luxury vehicles, Tesla vehicles are involved in more accidents.
The medical world is extremely conservative. The FDA has incredibly high standards to meet, thankfully, and demands ample scientific evidence for the medicines and treatments it approves.
"Move fast and break things" doesn't exist in the medical world, but it does exist outside of it in the form of unregulated supplements and illegal procedures and distribution of medication. People are routinely made into victims of this market just so someone can make a quick buck.
Anyway, move fast and break things is ingrained into the core of the medical profession when there is an unmet medical need.
The FDA for example has: Accelerated Approval, Fast track designation, Breakthrough therapy designation, and Priority Review all designed to speed things up when the benefits are significant.
They don’t apply for new pain medication because the risk vs reward is very different. 2014: https://www.fda.gov/media/94063/download
PS: I think we can agree that in terms of car safety there is clearly a large unmet need. That’s not to say self driving is the solution, just that it’s a serious contender.
If I offer you an untested unreliable cancer cure, on the grounds that moving slowly kills more in the long run, I'm likely to make things worse by putting out a non-cure. We could do some really fucked up human experimentation to save more lives in the long run, but that's not the ethics we've collectively agreed on.
Informed consent is a really big deal, but not a blanket exception for anything. Compensated participation for example is tricky. That’s the kind of issues that make medical ethics a complex subject and there are often difficult choices to be made.
Do you have a source for this claim?
Who at Tesla was held liable for designing a system that failed and resulted in death? Who at Tesla lost their licenses in the wake of deaths caused by their self-driving systems? Where is the culture of ensuring that their cars don't kill anyone again?
I’ll be the first to criticize Tesla for the shoddy, dangerously worded rollout of Autopilot. Totally. Has it saved more lives than lost? Who knows.
But to argue that googles more conservative approach should somehow deliver FSD faster is just a contradiction. Perhaps they brute force it like I said already. But the fast rollout by Tesla == more dangerous == more data. If you’re talking engineering delivery time, then yea Tesla is taking a calculated risk of getting much more data much faster. They should be able to deliver faster, engineering-wise.
You're just showcasing the immaturity of most software "engineers", yourself included.
First, you made a huge assumption. I never said I approve of how they are doing it. Engineering at the highest level encompasses morality, obviously.
But you wooshed real hard on the context of this thread in your rush to get that sweet feeling of moral superiority.
I’ll rewind it for you.
I was replying to someone claiming they hope Google delivers self-driving first because they see them as executing better at the engineering portion of doing so.
Do you see now? If they had said they see them as engineering more ethically and so they hope they win, fine. But they didn’t. Read it again.
The context is: is Google’s engineering strategy going to deliver self-driving first?
I replied to that. I even called out that you can totally disagree on moral grounds, and I do disagree with much of what they do, so it’s funny to call me out on something I was leaving purposely open as a further topic to discuss.
But the context was who would deliver self-driving faster, due strictly to their engineering strategy, I made the case that real world data trumps artificial data. And it does.
I'm pretty sure "don't kill user" is not only an engineering requirement, but the most important one.
There is indeed way more data captured than can be sent back, or even stored long term on the car.
Federated learning is a lot like distributed training of a neural network.
The trouble with distributed training is that it's not as fast to converge as simply running more training steps. It is basically like increasing the batch size.
Also, it sounds like a general hassle for Tesla to use federated learning. I believe they need to be carefully auditing and labelling their training data for almost all their tasks. Perhaps some like depth-estimation don't require labelled data.
"You are the product."
Now I see the problem of self driving is now just data and and computation, each of which grows by bounds every month...
can't believe the amount of 'wishful thinking can replace science' that Tesla pushes out
and now he has gotten into Neuralink and chips in the brains of pigs stupidness
marketing, brand image, any of the other dozen things that mask bad engineering quality and sell the customer on some superficial thing.
Not just in cars but a ton of consumer products customers can easily neglect engineering quality in favour of some gimmick.
Hell even developers constantly choose convenient or shiny technologies over ones that are robust or error free.
Tesla could win, with shoddy engineering, if they can convince the public and government (using the classic reality distortion field :) ) their self driving tech is ready for prime time (when, for the sake of argument, presume it's not ready).
They could then use the investment dollars generated to take it to the next level and perhaps make it solid over time -- but it could take a long time.
In the mean time, the public was effectively deceived as to the true safety level of the product. I would prefer if the opposite happened instead.
A crowded parking lot of a mall can be challenging for a beginner human driver, it's an absolute AI nightmare as there can be totally unexpectedly moving cars and pedestrians at any place and time. And then {rain,fog,snow} messes with LIDAR and you have a half blind (at best) system trying to navigate an extremely challenging environment.
I don't know what the fix is for this, the genies out of the bottle here. We won't have reliable self driving cars for years (decades?), and until then we're stuck in this horrible wild west where an off by one error can cause a pileup on the highway.
Let's stop the the assisted/self driving stuff until we have a regulatory framework that can prove the tech works in various conditions, much like seatbelts and collision testing.
The past century of car-based thinking has damaged the US's planning brains. We need to go back to first principles and think about serving the needs and wants of humans, rather than serving the needs of a hugely space inefficient and health-damaging transit mode.
You can't pick just one and say it's the best for everything.
I'm sure both Tesla and Waymo are looking at those research advancements.
> Traffic Light and Stop Sign Control is designed to come to a complete stop at all stoplights, even when they are green, unless the driver overrides the system. We found several problems with this system, including the basic idea that it goes against normal driving practice for a car to start slowing to a stop for a green light. At times, it also drove through stop signs, slammed on the brakes for yield signs even when the merge was clear, and stopped at every exit while going around a traffic circle.
(emphasis mine)
Is that really how this feature is intended to work?
You do not have to confirm if there is a car in front of you or it sees other cars proceeding through the intersection.
I think it (stopping at traffic controls) works quite well for a feature that rolled out only a few months ago. The article is generally accurate, but almost all these features are still labeled "beta" and work pretty well, though certainly not perfectly. The idea is they will improve over time and eventually get there, the article kind of assumes they are all supposed to be flawless which I don't think is particularly accurate.
If you interpret "Full Self Driving" as "everything works flawlessly" it's going to be a disappointment. That's fair enough for a naive reading of the phrase, you can argue that's overselling the potential of the feature, but perfect driving at this time is not what is actually claimed.
I think on balance all these features are pretty positive and designed smartly so that the driver can understand what is happening and correct the car's actions, and it does seem like they are improving over time.
There's no nuance here. He's lying in his marketing. Even a Musk fanboy can't argue that
I'm not saying it isn't good, it just isn't what he claims it is.
The idea is that you buy an option for the car that they claim will not now but in the future allow the car to qualify as “Full Self Driving” by some definition. It is not claimed that it will do that now, it’s fine to be skeptical that will ever happen to your satisfaction, but the feature has always been something that will be delivered over time.
There isn't room for a threat-to-life feature to improve incrementally, and it's very curious to see anyone suggest that it's somehow tolerable to risk the lives of customers with not-quite-there-yet-but-we'll-get-back-to-you-soon features.
I don’t think I buy that a driver assistance system that does not always intervene is dangerous, when the expectation, design, and legal agreement is you must drive the car responsibly. I’m not sure it’s conceptually different from a safety perspective as something like cruise control.
I mean, how else would one read it?
I mean, come on.
So the question for Tesla is, do they make it clear that what they're selling is a promise to build a self-driving system for the car later, and not a self-driving car now?
I think there's a pretty good argument that some of their advertising is misleading. But I don't think it's as ridiculous as some people here make it seem. I just checked, and they make it pretty clear before purchasing:
> The currently enabled features require active driver supervision and do not make the vehicle autonomous.
Ever get into a situation where there's on-ramps and off-ramps on both sides, you've never been on that stretch of road before and there's a lot of traffic? Driver conversation stops. Driver paying attention to the audiobook or podcast playing stops. It takes all your attention.
If that's the case, then maybe we won't get true self-driving until these systems have the processing power of a human brain...
A decade or so ago I decided to get my motorcycle license, and one of the changes to the testing regime that had come about since I got my car license was that you are required to verbalise any risks you are seeing: drive along saying "oncoming traffic, pedestrian approaching the edge of the footpath, driveway" and so on. It's an interesting thing to do because it's remarkable to understand just how much background processing that you are doing, and how many subtle hints you might be getting - the direction a person is looking and other body language are influencing your assessment of whether someone is likely to wait at the edge of an intersection or just step out; if the lights on a car blink as a person walks towards it, they're probably about to get into it rather than cross the road, and so on.
One advantage cars with large sensor suites have over humans is that they can see and process information from all around them. In your specific example, the car can watch both on an off ramps at the same time, isn't phased by the "newness" of the road since other cars have navigated this section of road hundreds of times before it has, and can keep tabs on cars obscured by line of sight due to the car's ability to bounce signals off of vehicles.
Along the same vein, most drivers will become extra vigilant of another car that's driving in a way that's the least bit erratic, giving that car a wide berth.
ENIAC exceeded the processing power of a human brain. Only for solving systems of equations, a task which humans find very difficult, and for which computers are naturally suited. But we would never have built it if this weren't the case.
Chess fell to AI decades before Go did, because computers find Go more difficult, due to the much greater branching factor. Humans are more naturally suited to Go, we can "cheat" by training our built-in shape and pattern recognition subsystems.
It's true that driving a car recruits many adaptive subsystems of a human brain. It's further along the spectrum of 'easy for humans, hard for computers'. But what I want to illustrate is that the 'processing power of a human brain' isn't very well-defined, and isn't the relevant factor for why self-driving has proven remarkably difficult.
It's not clear to me that full self-driving, at the level where there's no steering wheel in the car, can be achieved without general AI. I don't even think it's a useful goal, since the really difficult tasks are things like "park your car in this particular place in a field when arriving at a wedding", rather than situations a human would have to suddenly take over for.
But I have to employ my full concentration to add two five-digit numbers in my head, and while I once knew the trick for multiplication, today I'm quite incapable. Yet there's nothing more trivial for a computer.
5 years later and even for an extra $8k we still don't have hands-free autopilot.
You are not a beta tester testing out pre-release software, the features you received are considered complete.
The stationary object detection problem that has caused fatalities is industry wide.
The combination of failures that lead to Walter Huang's death however aren't in my opinion.
I think GM's monitoring system is the right solution until FSD is solved, Tesla's steering wheel torque monitoring isn't enough.
Well, then, why are they labelled 'beta'?
Inb4 Dr. Frankenstein was the first ML pioneer.
The everyone you hear from is very different from the everyone I hear from. I dislike Tesla's approach, but you have to admit that a ton of people are on board their hype train.
Tesla is never going to have a solid self driving system without LiDAR. Radar’s range is limited and cameras are simply not suitable for reliable depth perception and bounding box detection.
Edit: I wonder if a human can learn to drive a Tesla remotely better than another human with radar and multiple camera input by representing them in some useful way.
No car can come close to doing that.
So far they have made significant fixes and rolled out new features. As long as they keep that up they'll eventually deliver something reliable with all the features listed.
As to when, it'll probably be next season. No clue on which year though... :P
Elon Musk is just blatantly falsely advertising FSD by this point. He's trying to sell a technology that a) doesn't exist, and b) has no guarantees of being ready anytime soon. I wouldn't be surprised if people started demanding refunds pretty soon.
Personally I think level 3 should be banned (can't find it, but I think Volvo blogged about it years ago), because the system just cannot detect that it will fail in some seconds and give the driver enough time to react.
By the way, Google's tiny slow cars driving in the valley only were exactly the strategy to limit the operational domain. Once they opened up that domain, they started to struggle again with the same problems as all others (admittedly on another level of mastering it though)...
[0] https://www.theverge.com/2020/2/24/21150546/tesla-autopilot-...