Researchers fool self-driving cars with stickers on street signs (2017)
thedrive.com
thedrive.com
In fact, road signs are just stickers on a bit of metal themselves.
Also something that fools humans about street signs would probably also fool AI
[1]: https://www.caranddriver.com/news/a15340148/researchers-find...
That wouldn't fool a person. People use a massive amount of contextual data, historical knowledge, and common sense to interpret the world around them. A random out-of-place sign like a 65mph marker at a junction where a stop sign might be isn't enough to trick someone.
Self-driving cars probably won't ever be as good as a person at this. That's fine because we're able to accept a small risk if the reward is enough of a benefit. Law-makers should be considering it and making "tampering with a road sign" a much more serious explicit crime that's worse than just basic vandelism though.
When discussing this I don't hear the positives
This isn't kindergarten or a 1on1 meeting where you wrap the negative comments in positive comments. This is a harsh review of a piece of tech being touted as the next coming yet has such horrible faults that it can't be anything but a hobby project at best. This has the ability to kill people because of these faults, so telling bobbyDriverlessCar that he did pretty good, but has one area that needs improvement because you don't want to destroy bobbyDriverlessCar's over inflated ego is just a dumb way to think of this.
Either way you're defacing infrastructure in a way that's potentially dangerous. It's just that the particular failure cases for an AI is different (and somewhat incomprehensible) to humans.
Of course, a self driving system could also be linked to a network that has redundant information about the road and could also broadcast its position and immediate intent to all other nearby self driving systems.
Now, on the other hand. If a police officer sees a missing stop sign, then it's pretty obvious that there is something that needs to be reported and addressed. However, if there's a small sticker on a stop sign (possibly something even confusable as just dirt or bird poop) then it might not be obvious that this represents a road hazard.
I believe that if car crash deaths were reduced to 4,500/year in the U.S. with only self-driving cars on the road — a 90% drop from last year's actual 45,000 — an overwhelming majority of Americans would still reject self-driving cars because of the loss of agency involved.
Edit: Also, I think that many of the casualties resulting from autonomous vehicles will be situations that humans could have easily avoided (vs. lots of saved situations where humans couldn't have done anything).
But then, aggressive drivers will be the last ones to put the autopilot on I'm sure, they're also the ones that will insist on the agency aspect of driving.
This would not just affect the adoption of autonomous vehicles but all kinds of automated systems without direct human oversight. If the system makes too many mistakes a human would catch but prevents many mistakes a human wouldn't, the best of both worlds is to have a human in the loop and catch all the mistakes that can be made.
People often pitch this view but don’t provide real numbers.
Can you please link to the lawsuit? It could be one related to unnecessary emergency breaking which would likely be annoying but not cause death.
Just that subtle hint that the speed limit has been reached would likely keep me near the limit most of the time. I don’t even want it to prevent me from exceeding the speed limit.
This doesn’t help with the 95% of other cars that don’t know the speed limit, but it has to start somewhere. It seems odd that my car has redundant features and alerts for avoiding speed traps and traffic cameras, but little to actively help me stay within posted traffic rules.
Basically I prefer to be exposed to risks that a human "can't" avoid than from something like this which a human wouldn't do: https://www.sfgate.com/bayarea/article/tesla-firetruck-car-c...
I assure you that false collision alarms are causing accidents that aren't being accounted for, some of them serious. Just as with first-generation airbags that did more harm than good to children and properly-belted passengers, it'll take a while for the actuaries and statisticians to catch up with how modern cars are actually behaving on the road. At that point a cynic might predict (or even hope for) the trial lawyers to take it from there.
Last to catch on will be the legislators who have mandated auto-braking tech without imposing strict performance and reliabilty standards.
People were worried about dying from electricity—a power source out of their control—to turn on their lights, and it certainly did and still does kill people, but more people died by starting fires in their homes to read at night or stay warm. But the number of people wanting to replace their lightbulbs with candles for a little extra control of their energy source is quite low (although they do exist).
And very rightly so. Someone who never drinks under influence and nearly always drives during the day (say to/from school) and is driving since 30 years has a probability so much lower to be involved in a deadly crash than a 18 years old on alcohol or drug driving on a Saturday night that it'd require much more than a 90% drop for that person to be safer by moving to a self-driving car if they were to only create 90% less accidents.
Here's something totally bonkers: in several statistics the car brand the less involved in car crashes (per miles or per 1000 cars of that brand or per anything you want) is...
Porsche.
You read that correctly. And it's not because Porsche repeatedly gets amazing short braking distances compared to other car brands: it's because young inexperienced people don't have the means to buy a Porsche (and Porsche are still pretty much regular cars, not crazy nervous stuff like Ferrari or Lamborghini).
If self-driving cars could be implicated in 90% less accident, the winning strategy would very likely be something like this: "put anyone under 25 years (and over a certain age too) in a self-driving car".
And maybe, maybe, once self-driving cars are implicated in 99% less accidents, experienced drivers never driving under influence would accept to move to self-driving cars.
There's absolutely no reason that those the less likely to have crashes should be moving to cars that are less likely to create crashes for those the most likely to be implicated in crashes.
"Moving everybody to self-driving cars" is the wrong way to think about the issue.
It's the segment at risks that should be moved to self-driving cars.
People just look at the total number of accidents and don't realize that "Porsche on the highway driven by an experienced drive bringing his kids back from school during daytime" is not anywhere near as likely as having a serious crash compared to "teenager on alcohol or drugs driving on a secondary road on a Friday night".
They're not even comparable. A rounding error.
Put it this way: it you were to get a 90% by moving everybody to self-driving car, you'd get an even bigger than 90% drop by moving only those in the segment at risks to self-driving cars.
And then, later on, once self-driving cars drive near perfection, you can move everybody to self-driving cars.
P.S: and to put things into perspective, we're talking about self-driving cars being fooled by stickers or bird poo on street signs. There's still some way to go.
[1] Man beats machine at Go, https://arstechnica.com/information-technology/2023/02/man-b...
Fooling a 2017 Tesla or fooling a 2017 Waymo is a big difference.