I wish this sentiment was more common. Don't we all want the future to win?
I wish this sentiment was more common. Don't we all want the future to win?
It's ludicrous to expect that an otherwise untrained, average human can keep up his or her attention while day by day the automation just works. It's just not how human psychology works. Someone called this particular kind of operation here the "deadly valley" because it's good enough to lure you to be relaxed and not good enough to solve all the kind of possible problems.
I absolutely want the future to win, and I'm terribly afraid that Tesla in its hastiness might hurt the progress.
http://news.nationalpost.com/news/world/disaster-on-autopilo...
Despite more crowded skies and terrorist attacks, airline safety has improved since (or perhaps during) autopilot came along [1]. Definitely not causation, but you could argue that autopilot allows pilots to fly more and make air travel more affordable, reducing the reliance on less safe forms of travel. Plus, if it bleeds it leads, and the public wants solutions for everything, despite having an improved quality of life from the technology (most likely).
[1] https://en.wikipedia.org/wiki/Aviation_safety#Comparison_to_...
What are the on-the-road stats for automatic driving? Aren't they better than human drivers already?
Its not a failing, just because they have different failure modes than humans. Because our human failings are so many and so frequent. There's so much low-hanging fruit. Auto-driving never gets tired, never argues with the passenger, never gets distracted by changing the playlist.
We're net ahead already with auto-driving.
Probably not. The fatality rate for urban interstates in 2007 was 0.54 per 100 million miles. That's the type of environment--safe, predictable--where autopilot is most likely to be activated.
With one fatality, we don't have a really accurate picture of Tesla's fatality rate yet, but our best estimate at this point (0.76 per 100 million miles) is higher than that.
Based on what?
> With one fatality, we don't have a really accurate picture of Tesla's fatality rate yet
Correct. You'd need at least 32 deaths. Until then, there is no "probably" one way or the other.
Deaths are also a poor metric, since car safety comes into the picture. You're better off using pure reported accidents instead.
No, that was not his point. He said "Probably not."
That's wrong. It's not probably anything. Both the parent and gp are wrong.
And the negative tone of your comment is wrong too, since there is no evidence to suggest a problem with autopilot. Wait until the data is in. One dead dude and a couple of accidents doesn't mean a damn thing with millions of miles driven. It might be worse, it might be better. That's not an indictment, that's the case with anything new.
That future can't come fast enough for me.
It'll be rather amusing to see the older generations chomping at the bit for the introduction (nay, making mandatory!) of revolutionary new tech.
The youngsters mostly seem rather apathetic towards driving, but there must be a bunch of about-middle-aged drivers who'll resent having their toys taken away (or the ability to use them on public roads, same difference).
This is my line of thought as well. Same problem I have with the anti-nuclear environmental crowd. Are there substantial drawbacks? Absolutely.
That doesn't matter. The important question is not "Does this new technology solve all previous problems?" but rather "Does this technology solve a net positive number of problems while offering more opportunities for improvement?"
With decades of empirical data that average humans are pretty bad at reliably manually piloting powerful, heavy vehicles, I can't see a reasonable reason to reject deploying autopilot technology in an aggressive manner. And that sadly means a few deaths. But those should be measured against the number that would have died were nothing done, not against zero.
What you don't understand is deploying a driving assistance feature is probably the fastest and most efficient way of improving the system because it is the fastest way to collect huge amounts of data. When used properly (As the machine reminds you each time you use it), it should always be a safer option than regular driving with the added benefit of providing valuable data to improve the system.
You should rephrase your question to: "What value is an Autopilot if it kills you when you use it in a way it explicitly told you not to?"
Interestingly, curious if that's why Tesla equipped cars with sensors before enabling autopilot as a user option. Hypothetically, can't see why they couldn't have downloaded the autopilot code to cars and been running it in ghost mode while users drove, generating faults whenever errors were encountered and sending the relevant sensor data back home.
Deep plowing was probably the fastest and most efficient way to farm the Great Plains because you could quickly and easily turn up huge tracts of fertile land.
Then the dust storms came.
What value is an Autopilot that knows you are not using it the way you are supposed to, but keeps accelerating you anyway?
Good point. An autopilot, whose sole purpose is learning, should make sure the user is engaged so it's provided correcting feedback.
>What is important is: what are the odds of getting decapitated while driving vs. autopilot.
Such odds are pretty much impossible to calculate. We know of one instance where a Tesla intentionally drove into a situation where decapitation was inevitable. It happens to manual drivers as well, but not typically without additional circumstances (high speeds, prior crash/accident). Usually if your head is about to impact something, you will react quickly enough to save it.
That's is patently false since 30K people die in car collisions every year in the US alone. Stop focusing on the anecdote, the one death, and look at the numbers.
> I used the word three times. All in highly relevant questions.
They are all irrelevant because they focus on the one, the individual, the act, the emotional.
That's not how good policy is made.
>They are all irrelevant because they focus on the one, the individual, the act, the emotional.
I can parse this sentence, but I don't know what it means. The act, the emotional?
To play advocatus diaboli: Shouldn't it be sufficient for the autopilot to be as good as the worst human drivers that we still let on the road? Or to sharpen the point: As good as the worst licensed drivers under human supervision (compare learner's permit)?
After all the technology is still "learning", under human supervision. And similarly a teenager having a parent as co-pilot does not only endanger their own life but also those of others too.
So if those are allowed on the road with the expectation that they'll get better and that giving them a licence will eventually have net benefits, shouldn't that apply to self-driving cars too?
If nothing else, one could have "pilots" guide the trucks by remote control for the last mile.
You're not providing any argument for the ease of legalization here.
The unions can only have direct leverage with companies that currently employ truckers and those that work closely with those companies. All it takes is for one tech company that doesn't fit into the above category to develop the technology, then the market will make the licensing of such devices inevitable.
You thought you were giving a clever rejoinder. However, I was specifically talking about companies that don't directly employ large numbers of truck drivers. Then it comes down to the economic power of the companies that operate the trucks versus the economic power of the companies that have to pay the trucking companies. The latter is going to win the lobbying contest by sheer size.
Many people are unwilling to cede control of their automobiles even if the statistics support the case of their car being safer when driven autonomously.
The "infinite trolley" problem puts this into better perspective, IMO: https://backchannel.com/reinventing-the-trolley-problem-85f3...
Beyond that, tesla is not an autonomous vehicle. From what I can tell, it is not outfitted with the sensors to make it a viable autonomous vehicle. The danger is marketing it as an autonomous vehicle while having fine print saying that it is not.
Honestly it seems like the big deal is that it is Tesla and how they marketed the feature.
You better believe it. If I sell you a climbing rope and it fails, saying "yeh, but the average human wouldn't have been able to hold you as you came over that ledge" is not a suitable excuse.
Well, being a different sort of entity, an auto-pilot will never be the same as a human driver. So "as good as" has to essentially imply "better than".
"What are the on-the-road stats for automatic driving? Aren't they better than human drivers already?"
Apparently not as enoch_r points out.
Further, there's miles-driven and quality of miles. Suppose, just suppose, the average driver starts out barely trusting Tesla and using auto-pilot on short runs in clearly safe conditions and this same average driver over-time trusts Tesla more and more until they reach the point that they trust in situations they shouldn't - and then you get a series of accidents.
Yes it must. I can readily accept responsibility if there was something on the road to which I wasn't able to respond properly and resulted in an accident but if it was autopilot that screwed up I would sue $brand's ass.
Well, if you want people to use the tech you need to be able to tell them that the car is at least as good as they are and in reality better than they think they are.
That's no really the problem though. The problem is the current generation of automatic driving is not automatic at all. It is assisted driving - i.e. an evolved cruise control - and the problem with it is that it requires inhuman circumstance to work alright ( driver being alert despite not having to do anything ).
There is case on what amount of assistance is actually too much to avoid that "death valley".
Automatic systems are another problem entirely. If a human intervention is necessary, automatic system need to be designed for a human not ready.
The currently assisted driving system in the Tesla is used as an automatic driving system by misguided drivers. The risk is that this mistake is going to hurt public goodwill in adopting real automatic system when they are available.
Yes. Imagine that it crashes with the same average incidence rate as humans. Humans are imperfect creatures. They break the law. Let's even say that only 1% of crashes involve someone breaking the law (intoxicated, no licence etc). If the car is only on par with humans, then the car is only able to match a law abiding citizen 99% of the time.
You could argue that the car is basically driving buzzed. We have laws that would arrest 1 out of every 100 of those humans, but what would we do to the algorithm? What sort of punishment could you do to it when it messes up?
Speeding? Let's then raise that 1% to like 40% or something. Looking at some random sources[0][1], all the most common causes of traffic fatalities are the ones machines already deal better with than humans. Distracted driving? Check. Failure to stay in lane? Check. Speeding? Check. People die on the roads mostly because drivers behave like idiots or hit their natural limitations.
[0] - http://www.businessinsider.com/the-cause-of-the-most-fatal-c...
[1] - http://www.sixwise.com/newsletters/05/07/20/the-6-most-commo...
I haven't drove the only system that calls itself autopilot, but some of the comparable systems from other manufacturers.
In my opinions the cars are significantly worse drivers than the average human. Their perception field is tiny to what a human can recognize (especially with 1 camera / 1 radar systems), they partly react later than a human can do (e.g. you see a traffic jam 700m ahead or other cars wanting to change the lane far ahead) and their lane holding is not really smooth.
They have one theoretical advantage at the moment: They don't get tired or distracted and make errors because of that. They might even have better reaction times in some situations.
However in the same way that humans can fail in 1000 ways the software can do that too. You could argue that humans won't be prone to buffer overflows, segfaults, deadlocks or other kinds of bugs. Most automotive software is written in C - which is here most often not even trusted for non-safety related jobs. And although the software is probably better reviewed and tested than the average web or consumer app there's still a lot of room for errors due to various reasons. And developing some completely new system with an insane kind of complexity (automated driving) won't make that easier.
Life would have been a little better for them had they not bundled relatively common ACC tech with bleeding edge lane-management tech, called it all one thing (autopilot) and then said that thing was in beta. Basically they hyped almost-industry-standard ACC off the charts and are now getting special scrutiny for it.
On another note, saying your driver safety system is in beta testing is its own fail, just with the word "beta" that screams "still has bugs." They really need to watch out with the crossing over of tech culture idioms to vehicles. There were probably other ways to position that tech.
> We're net ahead already with auto-driving.
We don't really have enough data to know that. Really, we haven't even scratched the surface of figuring out if that is true. E.g. we have no idea what kind of emergent phenomena will arise when roads full of self-driving cars interact with each other.
History is littered with examples of engineers thinking they were 90% of the way there when they were actually like 10% of the way there.
I believe that could give them alot of data to analyze.
You could even make some kind of tournament out of it...
* http://fiaformulae.com/en/news/2015/november/formula-e-kinet...
Formula E isn't well regarded in racing fan circles - I personally try to catch the races when I can but I don't have cable and hardly ever watch so I don't know the state of the racing this year.
It will be Mr. Musk's responsibility if (when) he disables manual driving option fully, without the opportunity to take back the control.
So far, everything's well.
Left unchecked, that's possible, but I think we have a chance here to ask for more reports on accidents involving autopilot. If Tesla were more transparent, it'd be easier to collaborate on solutions.
Although there is a lot of junk out there already: http://i.stack.imgur.com/nxIh2.jpg
Look, I'm a robotics engineer, so my job security and career prospects directly depend on technologies like autonomous cars becoming mainstream.
That said, the way Tesla is rolling out this technology is just irresponsible. An excellent post from yesterday [1] succinctly outlined the deficiencies of the system, which are now obvious to people outside of Tesla. Given this list, if I were in charge there, this technology would NOT see the light of day until these defects were properly fixed.
Beyond the technical problems, there is also a social issue that Tesla is exacerbating. For the last few years now, the general public has been hearing from a variety of popular media sources that autonomous cars are "right around the corner". People have been told that these cars will use their superior computer minds to virtually eliminate traffic accidents.
Now you have Tesla producing a car with a feature that sounds a lot like "driverless car" to normal people; right or wrong, it seems like people are treating it with the expectation that it's one of these magical life-saving driverless cars they've been hearing about.
To Tesla's credit, the feature does work well given the correct conditions. The common user probably couldn't tell you the difference between "autopilot" and an actual autonomous car. Yet, the user is not properly aware of the limits of the system, and Tesla itself doesn't do much to educate users about those limits. Further, Tesla doesn't seem to do anything to keep users safe when they get close to those edges.
What you have here is insufficient and untested technology being used in a production environment by users who have the wrong expectations about what the technology is. The result, as we have seen, ends in death.
And no, these failures are not inevitable conclusions of statistics. These failures are due to concrete, identifiable engineering and messaging issues that can and should have been corrected before the product was ever introduced to production cars.
> unsuspecting victims
Is a bit much in my opinion. They are operating heavy machinery, and decide not to follow the clearly stated operational guidelines. People are not children, driving a car is a responsibility.
Note: I'm not saying that such accidents aren't tragic, or that the drivers 'deserve it' in any way. Simply pointing out that no one forced anyone to take their hands off the wheel, or subject themselves to driverless testing.
But they are unsuspecting in that they spent $60k on a car, $2500 to install the autopilot feature, and another $3000 to just enable the autopilot feature. And what they get from that, is something that can keep a lane, but with a laundry list of caveats: It doesn't work if the road is too curvy, or if the lane markers are too faded, or in the snow or rain or dust, or if it's too sunny out, or if the obstacle is too high (but low enough that it will still decapitate you), or ... or ... or .......
So I would say, that Tesla is still testing this feature, and customers really aren't aware that they're spending ~$5500 for something they don't realize (and are not told) is deficient on multiple fronts.
Except what the author said isn't actually true in any regard what-so-ever. Point out the start-up that has raised a billion dollars to take selfies or find imaginary creatures. It's such a wild exaggeration, it missed by 10 or 20 fold.
Further, I can't locate nor have seen any evidence to support the claim that anybody considers those types of apps to be the apex of human civilization. Despite that bogus claim being endlessly repeated by the press and other cynics.
Meanwhile Tesla has actually raised billions of dollars in capital.
And meanwhile, Elon Musk is considered a visionary that is taking the human race forward and has accomplished breathtaking feats of technological integration and application. Tesla and SpaceX are renowned for what they're accomplishing, apps to take selfies are not - and they're not being lauded anywhere. (and no, Snapchat isn't an app to take selfies, it's a communication platform that is extraordinarily valuable to people and properly so)
The author rehashed a very commonly abused strawman and then proceeded to beat on it.
http://blog.samaltman.com/hard-tech-is-back
I think the public perception problem is that "people invest in / read about things they understand." By definition, people are less likely to understand an enterprise predicated on cutting edge research than a realization of an existing market need by deploying existing technology. So the bubble talks about Snapchat but not battery technology startups (side gripe about deplorable state of popular scientific reporting).
---
Snapchat is an example of one that has, just fyi.
http://www.reuters.com/article/us-snapchat-funding-idUSKCN0Y...
> Messaging app Snapchat has raised $1.81 billion in funding, the company reported in a U.S. regulatory filing on Thursday, a sign that investor interest is strong despite concerns among some venture capitalists that the platform is struggling to attract advertisers.
Yeah, a "selfie-app" is basically a "messaging app that is used primarily to send pictures".
I'm sorry but there are 239042903490232930 of these and they don't justify this sort of fund raising in practical value to society.
It's easy to take this glowing 10,000 foot view of Musk/Tesla. Get down much lower and there are...issues that smack very much of dangerous, egomaniacal adventurism. Exhibit one is marketing a car that as being able to drive itself, then blaming drivers when the car fails to drive itself.
Also, I call bullshit on the idea that Musk isn't sitting on his fortune. It's everyone else's money he's using for fuel...$4.1B in government money IIRC plus god knows how much VC.
This comment doesn't even pass the laugh test for anyone who knows what happened to him in 2008 when all of his money was tied in his companies and then he got sued for divorce. He literally wound up running 3 companies that were imploding in different ways, and had to borrow from friends just to make living expenses.
He pulled everything off by the skin of his teeth, starting with his 4th SpaceX launch getting into space instead of blowing up as the first three rockets did.
He will raise money in every way that he can. Yes, this includes finding ways to get subsidies from the government if the government is willing to provide them. But it also includes investing his own money, time and effort. (And risking his life - his roadmap includes colonizing Mars, and he's serious about moving to that colony.)
Thanks for that laugh. I hadn't heard that one.
Let us not assume Musk gave up his fortunes and marriage out of the goodness of his heart. He stands to benefit heftily from Tesla's continued success. Assuming he is all good by himself would leave the rest of us as bystanders which isn't the case. We're all interested in contributing towards systems, both technical and social, that foster autonomous vehicles.
I have heard a few hilarious things from Musk, just not that one.
What is on Mars that could generate value for a private company? I'm not convinced investors would be on board for that.
I understand SpaceX can earn money shuttling things back and forth to the ISS. I do not see the benefit for them visiting Mars until a government decides to set up a base there. If SpaceX can find free money, more power to them.
Building an "app" to take selfies or find imaginary creatures in a porta-potty is a lower CODB, obviously, but it's a product people apparently value and it can be done by a small team[0] instead of a fleet. There have been a few HN threads that discussed successful software/games/webapps that were developed by a single person (Slither.IO)
Are we sure the future is really "winning" when it's headed toward a fully-immersive VR and hyper-intelligent AI that will essentially replace the need for most human labor?
The chief point I'm making is it's all very relative. Rushing headfirst into a new world sounds nice, but have we even stopped to consider and react on the negative impact that Social Media and our current innovations have made?
[0] http://www.wired.com/2015/09/whatsapp-serves-900-million-use...
If it's coupled with basic income, yes.
Just because you call it progress doesn't make it so.
The simple facts are, it does not work well enough to ensure the absolute safety of those using it or those not using it. It is horribly named for what it can actually do. Tesla needs to step up and admit it is not ready for prime time and since they cannot guarantee how their customers use it they cannot in good faith allow non designated testers from using it
It might be a valid argument if any of us actually thought that Pokemon Go was the apex of human civilization.
But we don't.
Yes. To get there, we can ask for more transparency from Tesla and other companies offering driver-assistance systems.