GM Cruise to delay commercial launch of self-driving cars to beyond 2019
reuters.com
reuters.com
The biggest safety issue associated with these cars is that everyone else honks and swerves aggressively to evade them when they stop short for dumb reasons like someone in the road waiting in front of their car for traffic to pass so they can get into their car —- these are actions I witness multiple times every day and if you look at every accident report associated with these cars you’ll see almost every case seems like a driver frustrated about being stuck behind it trying to swerve around it.
What isn’t recorded is all the accidents involving the cruise cars that don’t actually impact the cruise car. Like when someone swerving around a cruise car side swiped my neighbors car on Fulton. I almost saw a biker on 14th street by Valencia get hit in a similar manner when someone trying to evade the cruise car in the left lane swerved quickly into the right lane while the biker was avoiding a car in the right lane trying to turn right onto Valencia.
They almost certainly don’t collect statistics on accidents caused by other drivers who just want to get around these cars that clearly don’t need to be tested in a way that makes everyone’s commute just a little bit more obnoxious.
...drives dangerously and therefore illegally?
That's an indictment of human drivers, not self-driving vehicles.
So start aggressively ticketing all of the reckless humans and maybe that behavior will stop.
If you have to swerve, then you're not following at a safe distance. If you swerve without having to, that's also recklessly dangerous. Both behaviors _should_ be penalized.
FWIW, if you've ever done car/bike track days, this is a huge reason why it's so safe. People are split into groups according to skill level, with restrictions on passing (normally "only on the straights") for the lower groups. Much of the "skill level" here is actually just being predictable, not being outright fast. Someone can be in a Miata getting passed with a 50mph speed differential on a straight _because everyone is being predictable_. That same Miata might pass the same car with a huge speed differential at 90 mph in a turn, and it works because everyone is predictable.
And I'm pretty sure, in most jurisdictions, slamming on the breaks unexpectedly and for no good reason, will get you at least a portion of the liability for an accident. The person who rear-ends you will get some too, but its not always true that you can't be at fault when you get rear-ended.
As you imply, no safety system should rely on others doing their job perfectly. That is an inherently unsafe system.
It feels to me like whoever has written their braking algorithm is using bang bang control.
1000% sure Google will end up writing a check if someone dies because they rear-ended a google car that suddenly hit the breaks.
I know you're putting a gradual transition into context, but I see you say this ^, and my reaction is to suggest that we take human drivers off the road who recklessly endanger others instead of giving them a pass with the vehicular equivalent of "boys will be boys".
Drivers that adhere to the letter of the laws and totally disregarding the unwritten rules make terrible drivers because they do not follow the full set of rules that the majority of human drivers follow. All current autonomous cars drive like this. A small but infuriating subset of human drivers behave like this too. Generally it's expected that you pass these obstructions when possible and safe enough to do so (legal or not, though what's safe is usually legal too).
What people consider safe varies somewhat between people. Anyone will pass a tractor on a country two lane. Only the most bold will pass a Cruise in traffic. Of course there's a danger zone around it.
The current system is designed for humans and if we're ever going to automate it the autonomous cars need to be able to coexist with the human cars without causing problems. Boys will be boys isn't an excuse because it doesn't need to be. One of the engineering requirements is to get along with the boys.
I think the engineers know the software drives un-humanly but they can't change it because driving like a dick within the letter of the law results in far less legal liability than driving like a human and breaking the law.
This is wishful thinking and clearly false. If it were true, there wouldn't be any at-fault crashes. The only accurate claim you can make is "human traffic sometimes follows rules, and the rules that it sometimes follows change regularly from person to person and moment to moment". That's not a defensible state.
Implicit in your mistaken description is a pretense that humans are psychic and that we can predict what other people will do, but we aren't and, despite believing otherwise, we can't. That's why defensive driving is so important.
No it's not, but you'll likely never see it that way let alone admit you're wrong on the internet.
>If it were true, there wouldn't be any at-fault crashes.
Computers follow rules perfectly 100% of the time yet we still have software bugs.
>The only accurate claim you can make is "human traffic sometimes follows rules, and the rules that it sometimes follows change regularly from person to person and moment to moment".
You understand rules to be flexible and subject to some interpretation (like laws, not like a firewall config). Context is important. The rules that govern human interaction are complex.
>That's not a defensible state
This comment proves otherwise.
>Implicit in your mistaken description is a pretense that humans are psychic and that we can predict what other people will do, but we aren't and, despite believing otherwise, we can't
Humans don't need to be psychics to accurately predict what other drives will do. Humans are really good at pattern identification and picking up on subtle cues.
>That's why defensive driving is so important.
Being able to make accurate predictions of the future state of what is around you based on the current and past state of what is around you is far more helpful than defensiveness for any amount of defensiveness.
The behavior by AI vehicles fielded by Cruise and similar is a glaring example of that while defensiveness is great at avoiding liability it does not necessarily make the road around you safer (maybe even worse, as many comments anecdotally point out). This is the main gripe people have with AI and human driven vehicles that practice defensive driving to the point of absurdity. Defensive driving without human level ability to predict what other traffic will do is not sufficient for the kinds of situations that are regularly encountered in urban areas.
Most people will never get in a car crash in their entire lives (bumping into an object in a parking lot notwithstanding). I think that speaks for itself.
At-fault crashes are not analogous to software bugs. The computer didn't look at its phone when your code has bugs. Your off-by-one error didn't happen because the computer changed lanes suddenly without signaling.
Computers also don't follow predictable rules perfectly 100% of the time. That's why we have things like ECC memory and other single event upset detection.
You're working from an ideal model of the way you think things ought to work while ignoring the reality of what actually happens.
Just like enforcing drug laws doesn't seem to increase public safety (I welcome data one way or the other, but my understanding is it actually is a significant contributor to decreasing public safety), maybe we should be honest with ourselves about human behavior and write our laws to actually cater to that.
If humans reject self-driving cars, making laws protecting them isn't going to make people accept them. Make the self-driving cars actually acceptable to humans and then you don't even have a problem you try to solve with regulation.
Driving is strange in that there are upper bounds, but rarely lower bounds. i.e. a minimum speed is a rarity (and even more rarely enforced).
If I made the rules then we would have speed targets (not limits) and people would be penalized for driving outside of a +/- 10% range. After all, it's not speed itself that kills. It's a large and sudden speed delta.
Ideally, the speed targets would also be variable and data driven.
Also, crash your car off the road or into walls all you want. Just don't crash into someone else please.
So if you're reckless, swerve around it because you're frustrated, etc. be prepared to be held at-fault and watch your insurance rates skyrocket.
And every day we don't have solar cells are 2000% more efficient than current technology costs us tens of billions in lost value. What exactly is your point?
Don't forget the part where said drunk grandma's proponents say she's a great driver because she has so few at fault accidents. ;)
I'll take a small chance of being accidentally killed as a systemic, correctable mistake over the small chance of being killed by the 5% of people who are consistently impatient, inconsiderate dangerous jerks.
I think the most dangerous time to be a cyclist or pedestrian is right now. Smartphones are ubiquitous, distracted-driving enforcement is very weak (non-existent in my area), and self-driving is alpha quality.
SF is a completely different experience for bikes than it was 5 years ago, and 10 years before that it was even more different.
Ditto for NYC. You can ride up and down Manhattan in big separate big lanes very quickly.
It's obviously a personal choice, but I think cycling is a safe choice now. When I started 10+ years ago I would sometimes get off the road when conditions/traffic looked dangerous, and you should always keep that option in your back pocket. (i.e. don't insist that 100% of the route has to be bikable.)
But I don't feel the need to do that very much now. The exception is when there's unusual traffic and no bike lane.
It's even safer now that there are more cyclists on the road. Drivers do take some time to get used to cyclists.
But it isn't perfect - SF fwiw has had more pedestrian fatalities this year though they've had reductions in the prior couple years ( https://www.visionzerosf.org/wp-content/uploads/2019/07/06.2... )
Also average vehicle miles travelled in the US is up ( https://fred.stlouisfed.org/series/M12MTVUSM227NFWA/ ), and so are nationwide pedestrian fatalities: https://usa.streetsblog.org/2019/01/23/the-bible-belt-should...
Ride-hailing usage over transit may be part of the problem: https://steps.ucdavis.edu/new-research-ride-hailing-impacts-... ) .
In general, AI algorithms are famously opaque and hard to debug.
It's too long to explain here, but here are some links:
https://en.wikipedia.org/wiki/Explainable_artificial_intelli...
https://www.wired.com/story/greedy-brittle-opaque-and-shallo...
https://blogs.wsj.com/cio/2018/05/02/companies-grapple-with-...
https://thenextweb.com/artificial-intelligence/2017/04/23/ar...
https://towardsdatascience.com/need-for-explainability-in-ai...
https://www.forbes.com/sites/cognitiveworld/2018/12/20/geoff...
-----
BTW I'm also a cyclist. Human drivers can be annoying, but I find that they do act predictably. I've been cycling 5+ days a week in SF for 10+ years. I find that the drivers are worse when I bike in cities where bikes aren't as prevalent. Humans do learn. When you get into a conflict, there are emotions, and emotions are mechanisms for learning :)
It seems like you think that an AI is "just" a computer program, where the errors ARE indeed systematic and correctable. But AI is fundamentally different.
You can have road bikes, mountain bikes with similar sitting positions, or recumbents, which will need a very different training profile, or tandems, etc
Bikes are severely underrepresented in the list of things that car automation companies care about at the moment, so any self-driving car on the road today might misidentify bikes.
Bikes also often ride in positions (from the perspective of the car) that can be unexpected. Some can be as close to the side of the car that it can cover the full field of view of a side-looking camera for example. How do self-driving algorithms work when encountering such cyclists?
I sure don't want to find out myself - I would hope car companies are doing tests on closed courses with cyclist mocks or inputs.
How can you possibly know that?
So, why fall back on the status quo of a human to spot them? If SDCs are proven to do it better, then I will definitely cycle more once there are more SDCs. It's all about evidence, show me the evidence SDC's are better, then I'll be 95% on board.
1. The classification shouldn't happen from a single frame. In order to be misclassified as a shadow, the system would have to get the classification incorrect at various distances and you're probably moving too, so it would need to be across many frames.
2. This suggests that one sensor misclassifying will be sufficient for a deadly situation. But autonomous vehicles all use multiple sensors. They could even theoretically have multiple classification models running. One misclassification will not result in accidents.
3. Humans driving around effectively blindly is already an extremely dangerous situation.
4. This discussion is often limited to places where humans are distracted but overall trying to drive properly. In many parts of Asia (Korea, Taiwan, etc.) drivers very willingly disobey signals and are not at all deterred by the risk of hitting a pedestrian through their own impatience.
Humans are very dangerous behind the wheel. Hypothesizing about corner cases where autonomy might make a mistake is missing the forest for the trees.
Cars are the number one killer of children in America. Political action to reduce this number by redesigning cities to limit human/car interactions and providing safer transportation alternatives is stymied by opponents to who point to assuredly safe autonomous cars as being just around the corner.
See also Hypertube vs high speed rail and carbon capture vs carbon taxes.
We (in the US) have failed to make safer cities for about a hundred years already, so this sounds a bit like blaming people trying to build new fences for the existence of the wolves.
-Cars have power due to historical considerations: car lobbyists and rich car owners getting their environments designed for their own car-use.
-Hyperloop has almost nothing to do with high speed rail failing in the USA, it is a brand new concept and there were decades of destruction of trains by the auto industry and by the US's poor geographic make-up for trains.
-Carbon capture is just a fake-out by fossil fuel industry, there is no economic potential for CCS. Carbon taxes can't even pass in liberal WA in two referanda. Carbon taxes are simply extremely unpalatable, due to massive fossil-fuel lobbying against them and to subsidize fossil fuels. Therefore, most Americans are ignorant of just how much their fossil-fuel habits truly cost, since their other taxes and politicians ensure they are cheap and readily available with no taxation. Big moneyed interests have mortgaged our planet's future to keep gas at $2.50/gallon.
Everything is always five years away. That's the sweet spot for getting lots of funding while allowing time for the wow factor to wear off so you can backtrack on what you really intend to deliver (if anything at all).
This is going to be a huge business opportunity for car manufacturers and software companies, two industries with access to plenty of capital. So the not being left behind risk (FOMO) is naturally going to be high.
Combine that with potentially saving hundreds of thousands of lives from car accidents and being able to look at your phone instead of driving (freeing up countless human hours) and you have the recipe for extreme optimism.
The only important question is whether x company overpaid in the short term for acquisitions or scaling up ... and/or lack a runway to really achieve their goals. Otherwise it’s pretty par for the course, especially for software/innovation at this scale.
It’s quite possible we’ll hit these goals sooner now that industry went full bore on solving these problems and we’ll benefit as a society in many ways besides transportation from the AI work.
Most importantly, who cares if some pension funds and wealthy investors involved in high risk capital investment lose some money in the short term.
Yep, and in silicon valley, anyone who seriously plans for the consequences of this is dismissed as insufficiently futurist.
It’s hard to thrive as a responsible engineer when there’s always another huckster around the corner, willing to promise that 5-year future today.
Most software people have instincts that are all wrong on this because it’s the opposite of the usual experience.
For restricted access roads (i.e. highways), though, the technology seems ready to go. I know there is a lot of concern about the "hand-off problem", but that doesn't really seem like an insurmountable issue. If say 35 mins of a 45 min commute is on a highway, and only the last 10 mins are in a city, that seems like it would be a huge noon to tons of people if the car could take over, completely, on the highway. Are manufacturers likely to take this middle step first?
It’s good assistant, as those situations happen rarely, but they do happen and autopilot will crash if human won’t supervise and takeover
At least twice.
They compare overall crashes in all kind of normal highway environment and all kind of drivers and vehicles with the very selective places where the Tesla users decided to enable autopilot. Tesla users are also more educated and have better vehicles which has been shown to reduce the comparative crash rate by a lot.
We don't have data to compare but if I had to take a wild guess on crash rates I am pretty convinced that Tesla crashes more than the equivalent driver on the same stretch of highway as of today.
Then I was a GM tariffs sacrifice.
My understanding is that 5G should fix the winter/rain issues, as you can calculate location more precise.
I assume the cars would stop and we would have to go back to driving them manually for a few hours or days
And if you eliminate Tesla from the category, since they aren't using LIDAR, you can also point out that a self-driving car has never killed a passenger.
The only reason they have to wait is because they know the public expects perfection. The public doesn't understand statistics. If a self-driver kills a person, it would set the entire industry back decades, even though humans kill people with cars every single day.
People just aren't ready to accept that self-driving cars are safer, even if they aren't perfect.
Edits to reply to comments:
To those saying "It wouldn't work in my climate", that's probably true, but they aren't trying to make it work in your climate. All the self-driving companies are trying to release taxi services that work in cities with good weather.
To those saying "But pedestrians are important too", yes I agree with you. I was trying to point out that the fears of being inside a self-driving car are unfounded, because they are very safe. I still think I'd rather be around a bunch of self-driving cars outside too, but yes, they have killed people outside the car.
And on a side note, this is my most controversial comment ever. I've watched the points on this post as I reply elsewhere go from +3 to -3 and everywhere in-between. I think this right here sums up the public perception issues self driving companies have ahead of them.
I think you're misinformed.
Why should I be? I've been informed, by you, that it's a better driver than me, and I have no control over the software.
Let me say, these are not insurmountable problems, by any means. But the government moves slowly.
[0]: https://electrek.co/2019/05/02/details-of-teslas-new-insuran...
What liability question do you think there is?
If I buy industrial equipment, it comes with a set of safety recommendations, and requirements. On top of those may also be Labor & Industries, or OSHA.
If I fail to follow these, I as the owner am held responsible.
How do I ensure that the SDC follows these? How much control do I have over that, short of "don't buy/drive it"?
If I do follow these, I may also be hit with an insurance claim, but if I can show that the manufacturer didn't account for something I can probably also make a case against them to recoup some of my loss.
Given Tesla, for one egregious example, and their already demonstrated trend of trying to buck any and all responsibility for Autopilot-related collisions, how likely you do you think they are to step up to the plate for "Yes, our car should have determined that there was a pedestrian in the road and stopped, but didn't"?
Because I see it more that they will instead hide behind current software clauses, "not responsible for issues, errors, losses, defects".
If you upgrade to the special China style self driving package, the car will automatically back over any injuried pedestrians, ensuring that the pedestrian will not have to worry about the problem of who to hold responsible.
Also, I assume you are also considering all the times that humans entirely avoided dangerous situations that self-driving car wouldn't because they were able to anticipate the actions/movements of (possibly several) other actors/objects and even communicate with these other actors to negotiate intersections?
Do you have a source for the data that says self-driving cars have fewer accidents per mile? Does that include miles driven on closed tracks or is it just orders of magnitude lower than the miles driven by humans and less statistically significant?
I think the better reason to eliminate Tesla is that Tesla does not yet claim to have a feature complete self-driving car.
> If a self-driver kills a person, it would set the entire industry back decades, even though humans kill people with cars every single day.
In that case, we have already been set back decades by the Uber crash.
I mean a self-driver without a human safety driver. Many people blame the safety driver for that crash, so it saved the perception (even though it was totally the car's fault).
I still do not think that such an incident would cost decades, but undoubtedly the cost would be far higher than the Uber case.
It’s like someone claiming they are feature complete to be a composer, because they finished learning music notes.
Tesla is either lying or has no idea how complex FSD is.
No one in the public has enough data to say this conclusively.
>And if you eliminate Tesla from the category, since they aren't using LIDAR, you can also point out that a self-driving car has never killed a passenger.
Not killing pedestrians is just as, if not more important than not killing passengers. After all a pedestrian has no choice in interacting with the self-driving car. The passenger at least made an active choice to put their life in the hands of the technology.
I agree, but my point was that risk of death in the vehicle should not even be a concern for anyone, yet many will say (including other in this very thread) "I would never get inside one of these things".
The average driver-less car mile is a lot easier than the average human driven mile (driverless cars have far fewer miles handling inclement weather and rush hour traffic in non-grid cities than humans do) and the human average is dragged down by a small subset of the population that behaves badly.
Driver-less cars are not yet safer than typical drivers and this is before you count all the fender benders the early ones caused by violating social norms by behaving too conservatively in traffic.
Umm, this is leaving out the very relevant fact that a pedestrian WAS killed near Phoenix by a self driving Uber.
This is only a baseless opinion.
Stop making up statistics.
Stop making up statistics
> with fewer accidents per mile than humans
This sort of stat is highly misleading. The data is for testing on very safe very good condition roads and/or highways.
I highly suggest this source if you'd like a real look at self-driving car progress and not self-patting press releases from the carmakers or PR churns from the media:
https://ideas.4brad.com/gmcruise-leaks-show-them-way-way-beh...
My favorite was one he had on the security of self-driving cars (which is laughably inadequate):
http://ideas.4brad.com/disconnected-car-right-security-plan-...
Brad Templeton is a former EFF chairman and a former adviser to Google's self-driving car project (from before it was called Waymo).
Downtown San Francisco, where we had to avoid many obstacles, many people not following standard rules of the road, and major potholes.
How many miles did you do? How many corner cases happened? What was the weather like? And based on this experience you conclude that it's better than humans? How many Uber/Lyft accidents have you been in?
>The only reason they have to wait is because they know the public expects perfection. The public doesn't understand statistics.
It's way more complicated than obtaining perfection. For example, who is liable when a self-driving car crashes?
>I've been in a self-driving car -- it drove better than just about any Lyft or Uber I've ever been in. Th
Experience on an individual trip is not significant evidence on this topic.
>They're already safer than human drivers, with fewer accidents per mile than humans.
Safer in the specific environments they've exposed them too while rounding out the set of conditions, not a general sampling of typical driving.
I definitely think they'll eventually get there, but that's a separate question from whether they're there now.
I agree, it was just an anecdote to color my commentary.
> Safer in the specific environments they've exposed them too while rounding out the set of conditions, not a general sampling of typical driving.
And when they are released for general use, they will only be in those specific conditions. Every company pursuing self-driving is looking to launch a taxi service, which would limit the operation to areas where it is safe to do so.
Also, I believe that weather is a simpler problem than unpredictable behaviour from other cars, pedestrians, cyclists, delivery vehicles, emergency vehicles, construction, et cetera which occurs everywhere. Of course, it could turn out that both are insurmountable.
So are trains. What's your point? This is precisely why people say "I told you so!" - the level of non-exceptions required for them to get right is so numerous that this is exactly why it's a technology problem. Semantics here are important.
This is classic SV think - it worked for me on my shiny paved road from Palo Alto to Redwood City so it must work for the rest of the world. smh
That's literally the point I'm trying to make. Trains only riding on set rails is synonymous with an autonomous vehicles ability to drive on a set level of pristine road. Semantics are important here - these companies keep saying "we've got AD coming!" and then keeping throwing an asterix next to it ("note - in select markets only"). Can you see why people roll their eyes?
I mean, trivial things like Android Auto looks great, until you lose coverage, or your network gets really crappy -- then it starts to behave in ridiculous ways like: try to send a message, and instead of saying "I can't do that right now because X" or "I'll try later" it spins for a bit and then tells you that contact doesn't exist, etc.
If I can't trust SV engineers to deal with common edge cases that result from a place without perfect Internet on a product like _that_ -- why should I trust them to build a car that can handle a climate like mine, a place that has intense and powerful winters that cover all markings on the road, leave black ice patches all over, and have the cars around you using ad-hoc lanes or traffic patterns due to obstruction or severe conditions?
SMH indeed.
any actual public data? Because if you mean Tesla then you are wrong because autopilot is not self driving, the driver is supposed to be 100% involved, so from Tesla stats(that are not public) you can only conclude that driver+driver assist could be better then only driver.
There's no way you have enough good data to make this claim.
But yes if we exclude Tesla, ignore non-pax deaths, and vaguely extrapolate from the data released by current players they must be safer!