Self-driving cars are headed toward an AI roadblock
theverge.com
theverge.com
If Waymo has truly solved the problem while everybody else is just trying to catch up and/or bluffing, I guess I wouldn't be that surprised.
Edited to add: The reason is that they've apparently ordered 10's of thousands of these cars. Can they really use that many only in good-weather places with perfect roads? It seems unlikely that they are just that stupid to spend that much money without being confident that their plan will work. One last option would be that they intend to put 10's of thousands of them on the road just to exponentially speed up the data collection that they've decided is necessary to truly get the system up to par.
Waymo estimates about 50 trips per day will be served per vehicle. At that rate, 80k robotaxis is enough to displace most of the taxi/rideshare services in the southwestern United States, though I'm not expecting to see all of them on the roads until 2022 or so. Waymo has a ton of work ahead of them. Mapping and validating in the ~100 square mile area of Chandler has taken them about 18 months so far, and supposedly they are on the verge of a commercial launch. Every city they hope to deploy in has differing signage, differing driving habits, and many funky intersections and road anomalies that need specific attention.
Why?
I see comments like this constantly. But does anyone ever do even a basic spreadsheet to explain the unit economics of this argument?
Low skilled people who can drive are pretty cheap and plentiful. Even if self-driving tech is flawless (spoiler: it's not and won't be soon) it still only replaces part of their responsibilities. Someone will still have to clean the cars for example. Presumably there will be some required level of human monitoring, etc.
Conversely, capital and highly reliable technology isn't free. You can calculate pretty easily the rate at which it's profitable to substitute technology for labor, this is a trade-off we've literally been making for centuries.
One one side you have plentiful cheap low skilled labor. On the other you have lasers, fast computers, graphics cards, cameras, and the associated programming inspection and maintenance costs.
Why do we think the latter side is going to be cheaper in anything remotely like the near term?
A truck still needs to be able to drive in cities, and if you figure out how to automate all the other thing a trucker does you can replace 3 million of them. Big whoop. Robotaxis stand to challenge the economics of personal vehicle ownership, the potential market is many orders of magnitude larger.
That's plausible and incremental. No cleaning problems, no homeless people living in them, no need for remote monitoring, a far simpler liability and insurance situation, and so on.
My assumption is we'll start talking seriously about robotaxis on the day this scenario is practical and battle tested. The idea of starting with taxis seems ludicrous in comparison.
These are all solved problems, I mean when was the last time you saw a homeless person camped out in a Zip Car? BMW's ReachNow vehicles are all over Seattle and they are clean, insured, fueled/charged and exactly 0 people live in them.
I have yet to hear a compelling reason why I would give up my car, and if I did why public transit isn't a better option.
Yes, that cost will be offset by the cost of the extra hardware, but that can be amortized over tens (possibly hundreds) of thousands of miles. Likewise, the investment in software (programmers) will eat into profits, but once again, you can spread that cost out over hundreds of thousands or millions of cars. Besides, an awful lot of the latter is a sunk cost at this point.
Because, other than inspection and maintenance costs, everything on your list has been getting much cheaper really quickly for a long time.
A company deploying large mostly-homogenous autonomous fleets may be able to benefit from:
- we probably don't need to tip AVs
- economies of scale on obtaining vehicles, fuel, maintenance, and cleaning
- tuning maintenance/cleaning schedules across a fleet towards keeping vehicles in service for longer
- may be able to perform cleaning/maintenance during off-hours, vs owners who'll often have to trade
working hours to do these tasks
- autonomous systems may drive (and be tuned towards) in ways that also help preserve long-term vehicle
value and minimize costs
- lower insurance, legal, and PR costs if they outperform human drivers, don't molest/murder
passengers, etc.
- minimizing costs around acquiring and managing a human workforce
- there are probably many small ways to optimize the positioning and functioning of an AV fleet that
just won't work with a large contractor fleet
That said, the potential for a lot of these savings depends on current prices actually reflecting these components. It may very well be more expensive to perform some of these activities, no matter how efficiently, than to exploitively externalize their costs on drivers and riders.To give an example, my favorite coffee shop is about 7 minutes (+wait) from my apartment by car either way, and around 18-26 minutes (+wait) by bus (shorter there, longer back). Without a ride pass and with tip, it's probably around $7-8 to Uber this one way, vs. $1.25 for the bus.
At this price, I'll usually only Uber if heat or rain make getting to and from the bus miserable. I have a ride pass atm that knocks this down to around $6-7 with tip, which makes me marginally more likely to take Uber, but it isn't my default. I took the bus this past Sunday morning, planning to get some open source work done, but I'd forgotten my laptop wasn't in my bag. The time/sweat cost of the bus round trip and the money cost of the Uber round trip were high enough that I just sat and read a book instead.
I'm not sure exactly where, but somewhere between ~$2-5 total, I'd probably default to taking Uber both ways. Down at the low end of that range, I even would've gone back for the forgotten laptop.
That's a weird thought to have. Humans need on the order of ~15K a year in the US. On the other hand, even an ultra high end SDC computer costs only around ~12K in production and much, much less to actually make since Waymo will no doubt use their own TPUs. Lasers are cheap, compact and efficient fiber lasers. Cameras are mass produced in immense volume and are dirt cheap for very high quality. The only other factor is software development costs which is mostly a fixed cost.
Rental car companies show how few people it takes to maintain a very large fleet of vehicles and it will take even fewer if they can drive themselves (an autonomous car can go through a wash on its own, charge itself, show up at a detailing station on demand, etc).
Does that number reflect an analysis of the cost of the actual human work of driving the car only, or is that just the number for average actual remittances from Uber to the driver?
If so it includes assumption of capital risks, auto depreciation, gas, tire wear, broken glass, vandalism and cleaning, traffic tickets, maintenance, towing, and every other expense of physically delivering the ride.
Getting rid of the human driver only saves real money on driving labor. The payments to drivers have much more to them.
The number of hours per day the car needs cleaning will be drastically lower than the hours it needs driving.
The very fact that those things do need specific attention tells me they don't have true autonomy yet; they just have a way to fake it using detailed maps of known areas.
I don't see how an autonomous vehicle can handle all the corner cases of real-world driving (construction zones, etc.) until it can also work reliably using only available sensor data, so that detailed mapping is no longer necessary.
Which must be worrisome for competition.
[1]: https://en.wikipedia.org/wiki/Alphabet_Inc.
[2]: https://en.wikipedia.org/wiki/Automotive_industry#By_year
[3] https://www.dmv.ca.gov/portal/wcm/connect/5aa16cd3-39a5-402f...
Specifically, this section:
"According to the filing, Google and Motorola began discussions about Motorola's patent portfolio in early July, as well as the "intellectual property litigation and the potential impact of such litigation on the Android ecosystem".
Although the two companies discussed the possibility of an acquisition after the initial contact by Mr. Rubin, it was only after Motorola pushed back on the idea of patent sale that the acquisition talks picked up steam.
The turning point came during a meeting on July 6. At the meeting, Motorola CEO Sanjay Jha discussed the protection of the Android ecosystem with Google senior vice president Nikesh Arora, and during that talk Jha told Arora that "it could be problematic for Motorola Mobility to continue to exist as a stand-alone entity if it sold a large portion of its patent portfolio".
In connection with these discussions, the two companies signed a confidentiality and non-disclosure agreement that allowed Google to do due diligence on the company's patent portfolio."
While some have projected how many traditional vehicles they can displace, I don't think anyone really knows how that'll play out. I doubt any of these companies will go making bets that obviously rival the scale of traditional vehicle sales/ownership at the time they're made, especially before they get a sense of how reliable AV transit affects the decisions individuals make about car ownership as they face major maintenance, repairs, and replacement.
I've read one projection that says each could replace 10 traditional vehicles. If that worked out, it seems like a bet on 10m vehicles, enough to replace all 100m sold worldwide, would be astonishingly bold. If you assumed an initial scope of the entire US, the equivalent bold bet would be 1.7m vehicles. If you reduced the scope to California, that bet would be about 200k vehicles. If we guess that the difference between "astonishingly bold" and "bold" is an order of magnitude, these would be reduced to 1m, 170k, and 20k...
Google is buying a couple thousand Pacificas in the near future. That's it. It's more or less a commitment to keep buying a couple thousand a year for the next however-many years, in exchange for a discount.
It is NOT the case that Google is going to open a big box and find 62,000 vehicles inside in late 2018.
This article makes the further error of assuming “AI” is required for self-driving cars, rather than just a shitload of code.
Nobody knows because it has yet to happen. We have all seen demos and studies but that doesn't convince anyone not involved in the tech. Cars will be capable of driving themselves when I see one, sans humans, ask to merge in front of me on the highway. It will happen when I see one navigate the lineup to the ferry I take every week. It will happen when I see one accurately obey hand signals from a human directing traffic. Not youtube vids. It will happen when I see it with my own eyes. Just like electric cars, we will have to see them on the roads playing the game we all play every day. Until that tipping point, driverless remains a myth that happens in a faraway place.
So put them on the road. Let's give it a try. Maybe it works. Maybe it doesn't and people die and they sue. That's been part of driving since day one. Roll the dice. I'm sick of the endless debates.
Well I'd certainly hope that there is a high level of confidence that they don't kill people BEFORE they're put on the road with other people.
Don't. Cost isn't stopping people today from ridesharing. Carpooling won't become cool just because there is no driver, in fact I could see it becoming less cool as you will be much more alone with strangers. Many people today would be uncomfortable on a bus at night without a third party present (ie the driver, or at least many other strangers).
Think about all the extra traffic from autodriver cars doing jobs that today are too expensive. And the double-commute possibility. Your car takes you to work, drives itself home to park/recharge, then drives back to pick you up at the end of the day. Any 2-way trip could become 4-way, doubling the per-trip traffic. Or, rather than pay for parking while you shop downtown, you ask your car to drive around in circles until you are ready to go home.
> than the average sober, careful and experienced human driver
But ultimately we do accept the fatality rates caused by all drivers and not just the good ones as a cost of having individual transportation. If we didn't only teetotalers would be allowed to operate cars to remove one risk factor. And we also accept the risk of inexperienced drivers because we have to teach them eventually, the same reasoning can be applied to autonomous cars (just substitute teaching with data gathering)
The total distance driven also does not just depend on technology alone but on urban planning. AVs may change that dramatically over time.
> But ultimately we do accept the fatility rates caused by all drivers and not just the good ones as a cost of having individual transportation. If we didn't only teetotalers would be allowed to operate cars to remove one risk factor. And we also accept the risk of inexperienced drivers because we have to teach them eventually, the same reasoning can be applied to autonomous cars (just substitute teaching with data gathering)
We don't accept the fatality rates caused by all drivers; we confiscate the licenses of or jail bad drivers on a regular basis, and we certainly don't permit drivers being taught to operate commercially. Driver accountability for accidents is part of the social contract that permits individual transportation despite its cost; an corollary of that is that the accident rate is higher than we believe it should be, and that some degree of negligence is involved in the current level of accidents which it would seem unreasonable to exonerate corporations from if they were to replicate them using software. And on a purely practical basis, if you estimate SDV safety based on narrowly beating the mean accident rate across all drivers in tests, and then early commercial adoption tends to be replacing experienced commercial drivers who drive the most miles with the fewest incidents first, you're certainly going to push that accident rate up in the short run even without additional miles driven.
Uber could be skewing statistics in similar ways.
Anyway, this is all handwavy speculation. What I'm trying to get at is that the overton window for AV behavior may be surprisingly large, especially if they exhibit their worst behavior in the learning years when the fleets are still small. For some metrics possibly even larger than that for humans.
If the software is in active control pretty much everything that goes into that is different from software that is deciding if and when to emergency brake.
To put it another way, a self-driving system will become safer than human drivers, not because it knows how/when to emergency brake really well, but because it won’t have to emergency brake as frequently as a human does.
Everyone else performs a tradeoff along multiple axes including price, convenience and safety. Not needing a driver, freeing up time and lowering prices increase utility which could even justify a slight increase in risk. But even if we don't want to increase risk then a self-driving system still only has to be as good as humans on average to result in no net-increase of deaths per passenger mile while still increasing overall utility.
And more simply, it is silly to expect the maximum possible value to be the minimum requirement.
So it's all a numbers game. What's acceptable, and what we can improve on.
I’m not saying I want the highways to be a Wild West for self driving cars, but it’s worth admitting it would probably accelerate the pace of innovation.
Jesus... Let's kill people because you're sick of the debate on whether self driving cars will work.
I've been driving next to these cars for the past 7 years. A number of my friends & former coworkers have ridden in them; a couple of them work on them. They've stopped for me at pedestrian crosswalks. I've gotten stuck behind them, driving 25mph on El Camino. I've waved them on to make a left in front of me (I'm still not entirely sure how they do that, but I think that if they detect that the driver at the intersection is stopped and has not gone within any reasonable time period, they creep out and eventually go if no movement is detected). I saw one last week attempt to switch lanes, find that the car behind it had sped up and it was no longer safe to make the lane change, turn off its blinker, pull ahead in its own lane, and then make the lane change safely several cars up.
They are on the road, and they work pretty well. I trust them a lot more than cars that say "Student Driver Onboard", or even the average Californian driver.
Waymo is doing better than almost everyone else, a testament to their skill and their rigor, but they are still a long distance away from truly autonomous vehicles. The temptation is to say "well, they are so close, I'm sure they'll finish up the niggling details", but the reality is that the stuff they are failing at are some of the hardest remaining problems and will probably require at least as much work as they've put in already, if not significantly more, to tackle. I think we'll end up with self-driving cars eventually but probably not on a time scale of within the next 5-10 years, more likely it'll take that long or longer for the technology to reach maturity and then yet another decade plus for it to start seeing practical application.
This is the sad realization I had about brain-computer interfaces towards the end of my research. 99.9% is NOT good enough when the stakes are life and death and the factors within events that the environment throws at you are basically independent and continuous.
At least with self driving cars we can enforce some hard boundaries. In BCIs implementing boundaries is tantamount to denying the user of their free will.
see
>A select group of Arizonans has been shuttling around the Phoenix area in self-driving cars for the past year, providing insight into the future of the technology. http://ktar.com/story/2105890/waymo-early-rider-program-prov...
I am willing to assume that waymo/Tesla etc have found the holy Grail, and made a driverless car safer than the average current human driver on the road. I'm not convinced that we should still allow these driverless cars on the road with no human backups. Not because of expectations or liability, but because the benchmark is wrong. We should compare them to a human assisted by the same driverless technology being used passively to prevent accidents. And it's not clear if a driverless car with no human backup is safer than a human assisted by the same technology.
I'd say many millions of miles, actually :)
https://www.digitaltrends.com/cars/waymo-7-million-test-mile...
I think the real question is whether the big investors in self-driving cars will make progress creating virtual rails for their vehicles, e.g. roads where we can keep pedestrians out.
Aren't major roads pedestrian free in the US? Motorways and major roads are in the UK.
I've walked and cycled along multilane A-roads. It's not fun but it's legal.
So how do we get a determination of which disengagement events would have possibly lead to a crash? Plus I am still not convinced these numbers are even going to remotely similar over roads not heavily mapped and imaged. I think the hope many have for AV is that is allows for driving in the worst of conditions but in the end we will have AV for limited access or very tightly monitored road ways only. Which in itself is not a bad idea, rush hours could much safer and efficient with HOV/Express lanes redone to explicitly support AV.
We certainly aren't going to be able to get people to drive more lawfully when most think they are the better driver when compared to others.
I would hazard a guess that yes, that's pretty much the Southwestern US year round, if you include Southern CA. There are enough metro areas, and enough new sprawling development, to put those vehicles to work.
Waymo supposedly processes their lidar signals to detect other cars with reasonable accuracy even in snow/rain(https://youtu.be/UrJ4-AUL4U0?t=9m41s). They only operate in pre-mapped areas so they should be able to follow lanes just fine even if the actual markings are obscured (by weather or by poor maintenance).
This kind of approach (mapping everything beforehand and using lidar for perception) is used by other players as well, and seems the most likely to work for short term level 4. Trying to do everything without the benefits of lidar and high-res maps (what e.g. Tesla are doing) is a more general solution, and cheaper hardware-wise, but will take longer to get right.
Personally, I'm long on the camera-based approach because I think reliable autonomy will require a generalized vision solution, and once you've achieved that, the Lidar is redundant.
Motorola?
If you are buying 10,000 cars, what you are essentially doing is taking on that car manufacturer as a partner. You are betting that you will need the cars, and they are bettering that you will be around to pay for them. Everything remains speculative.
As I keep pointing out, the way you start to do automatic driving is by first profiling the terrain to see where you can go. If it's not flat road, you don't go there. Doesn't matter why it's not flat. Then try to classify other road objects and predict their behavior. This only matters for moving objects.
Waymo gets this, as we know from Urmson's talk at SXSW a few years back. Most of the DARPA Grand Challege vehicles got this, because they had to drive off-road, where you have to profile terrain or else.
Tesla does not get this. Cruise may or may not get this. Uber - well, Uber's system detected the pedestrian and ran into her anyway, which should end with someone in jail.
There's this mindset that you just throw deep learning at camera images and automatic driving comes out. Musk claimed that. It didn't work. We don't hear much from Tesla about self-driving any more. Udacity's self-driving course is also deep learning based.
As for how much testing is required, read the California DMV accident reports.[1] This gives you a sense of what the real-world problems are. 25 minor accidents so far this year. Mostly Cruise. The most common problem, especially with Waymo, is being rear-ended while cautiously entering an intersection with limited visibility. Their system will start forward to get a better view, then detect cross traffic and stop. What may help there is some convention such as rapidly flashing the brake lights when a sudden stop is likely and there's a vehicle close behind.
On the LIDAR front, Continental's flash LIDAR is already working well enough that drone makers are buying it. Continental is ready to produce that thing in volume, but they need volume orders from automakers before the price comes down.
[1] https://www.dmv.ca.gov/portal/dmv/detail/vr/autonomous/auton...
This actually highlights a really hard problem that (perfect) self driving will need to solve: theory of mind.
https://en.wikipedia.org/wiki/Theory_of_mind
Not only does the AI need to empathize and predict how typical humans react, they also need to be easy for humans to empathize with. Humans typically use themselves as a template for a reasonable range of reactions. So when the capabilities don't match up (like needing to scoot up to process how to cross where a typical human wouldn't need to), it will violate their expectation of you. So in this case being cautious is considered a crazy and erratic behavior to a human. (e.g., "what were you thinking?! why did you stop!? shouldn't you've seen that the road was empty?!")
I guess that's not quite the same scenario, though, since the person behind me couldn't see the cross traffic either; they were just cueing off my own behavior to conclude that it must be clear.
Anyway, you're right: good driving isn't just predicting what other people are going to do; it's also making sure your own behavior gives them the correct idea about your intentions.
Hm, this past season of Westworld kinda touched on how this very particular thought can easily go wrong.
Trying to avoid spoilers, one of the programmers commented on how the teeny tiniest tweak to parameters created Hosts that would [motions to what they were watching, a normally-benign personality killing townspeople for fun]. The awake Host with him commented "it's gone insane". His response was something along the lines of, "in the range of possible actions, what humans call 'sane' only exists in a very narrow band".
First link I clicked (Cruise "accident" on June 22, 2018) is pretty fantastic.
https://www.dmv.ca.gov/portal/wcm/connect/81d8865f-4c99-4342...
> A Cruise autonomous vehicle ("Cruise AV"), operating in autonomous mode, was traveling westbound on El Camino Del Mar between 32nd Ave and Legion of Honor Drive. The Cruise AV was struck by a golf ball from a nearby golf course causing damage to the Cruise AV's front driver windshield. There were no injuries and police were not called.
Shouldn't there be serious repercussions? But seems like he can fuck up majorly and people will still line up to blow him...he does have a BILF thing going for him.
Wow. What a goal post move. I don't think this is how successful technology spreads. Governments usually accomodate tech because it proves itself in the market, not vice versa.
To be clear, I am not in favor of building our urban transportation networks with an automotive mode focus. I feel that non-motorized transportation and safety needs to be the main focus, even if that means auto modes become inconvenient.
> Drive.AI founder Andrew Ng, a former Baidu executive and one of the industry’s most prominent boosters, argues the problem is less about building a perfect driving system than training bystanders to anticipate self-driving behavior. In other words, we can make roads safe for the cars instead of the other way around.
I'm not going to give up on crosswalks just so you can make money on your shmancy new cars.
Downward-spiraling is the internet default, so effort is needed to avoid it.
The guy in the article seems to be implying that pedestrians don't have the right to be in the road. I think it's pretty OK to be dismissive of that.
Point #2 is more subtle and more important. You picked an uncharitable interpretation in order to get snippy at it. That's a self-referential activity, not the thoughtful engagement we're looking for. This is why the site guidelines say:
"Please respond to the strongest plausible interpretation of what someone says, not a weaker one that's easier to criticize."
That applies to articles and quotes as much as to fellow commenters. If people just rail against weak versions of what others say, the only ones interested in reading it will be others in the same mood. Everyone else will get bored and leave, which in the long (or maybe not so long) run amounts to the death of this community. That's a downward spiral we really don't want, so please make an effort not to do that.
In short, please follow the rules: https://news.ycombinator.com/newsguidelines.html
"Fighting Traffic - The Dawn of the Motor Age in the American City" By Peter D. Norton
> Summary
> The fight for the future of the city street between pedestrians, street railways, and promoters of the automobile between 1915 and 1930.
> Before the advent of the automobile, users of city streets were diverse and included children at play and pedestrians at large. By 1930, most streets were primarily a motor thoroughfares where children did not belong and where pedestrians were condemned as “jaywalkers.” In Fighting Traffic, Peter Norton argues that to accommodate automobiles, the American city required not only a physical change but also a social one: before the city could be reconstructed for the sake of motorists, its streets had to be socially reconstructed as places where motorists belonged. It was not an evolution, he writes, but a bloody and sometimes violent revolution. Norton describes how street users struggled to define and redefine what streets were for. He examines developments in the crucial transitional years from the 1910s to the 1930s, uncovering a broad anti-automobile campaign that reviled motorists as “road hogs” or “speed demons” and cars as “juggernauts” or “death cars.” He considers the perspectives of all users—pedestrians, police (who had to become “traffic cops”), street railways, downtown businesses, traffic engineers (who often saw cars as the problem, not the solution), and automobile promoters. He finds that pedestrians and parents campaigned in moral terms, fighting for “justice.” Cities and downtown businesses tried to regulate traffic in the name of “efficiency.” Automotive interest groups, meanwhile, legitimized their claim to the streets by invoking “freedom”—a rhetorical stance of particular power in the United States. Fighting Traffic offers a new look at both the origins of the automotive city in America and how social groups shape technological change.
In regards to my initial point, government made regulations around cars after there was already an overwhelming market demand for them.
Isn't there a saying that 80% of the code is written to handle 20% of the cases?
Do you know that for certain? Or is it just that Uber were too lazy to cope with any complications that might arise if Volvo's system braked?
One solution would be to add censors to check after each ride if the interior of the car has been degraded.
They'll successfully promote the practice as offering greater security and warning you when you leave something behind.
"Tesla and a host of other imitators already sell a limited form of Autopilot"
Imitators? You mean GM, Mercedes and VAG that have had these systems for longer than Tesla are just bad copies of the glorious Tesla autopilot?
Unreal.
I don't think that's accurate. Autosteer is the fundamental innovation of Autopilot, and no other manufacturer released a system that "did, before or at the same time, similar functions" as Autosteer. Other manufacturers have since released systems that technically check the box of turning the wheel. But the value of a system isn't how it's described on paper; it's how useful it is on real roads. I haven't seen anyone release a system that's competitive with Tesla's except for Comma.ai (which is a very special case as they are not an OEM and only sell raw hardware).
"Imitators" wouldn't be my word of choice (it feels needlessly pejorative), but until someone actually innovates beyond what Tesla has done, I think it's fair to frame the conversation as the gold standard vs everything else.
> The "clones" are deliberately less good because the manufacturers offering them care more about safety and reliability than about marketing beta products.
When I say "maturity," I'm not talking about holding back features. I'm saying that Tesla's system works better in situations where other manufacturers offer similar features. For example, how many other manufacturer's TACC will slow down (below the set limit) when a turn is coming up and then accelerate through the turn as a human is taught to do? How many autosteering systems will sense an adjacent car drifting from its lane and "creep" away from it to avoid a possible collision? These are the sorts of mature behaviors that put Autopilot ahead of the pack and make it much more real-world useful than its competitors.
On irresponsibility, I passionately disagree. But rather than rehash a bunch of old discussions I'll just link to prior comments explaining why I feel the way I do, and we can debate it further in those comments if you're interested.
https://news.ycombinator.com/item?id=17302164
https://news.ycombinator.com/item?id=17233845
Thanks for the links to your other comments. I don't think there's fruitful debate to be had here - we're just of different opinions. I think autopilot encourages bad driving behavior in drivers who would otherwise be more alert, and if I've read your comments correctly you think the responsibility is nevertheless still on the drivers and autopilot probably helps more people than it harms. I'd love to revisit this if we ever get apples to apples accident data showing comparisons between autopilot-enabled vehicles and comparable vehicles from other manufacturers in the same price and age range (thus with corresponding modern and expensive ADAS systems).
I agree with this definition, but I see it more as a sliding scale than a checkbox. I think it comes down to whether you look at each system in isolation or whether you put them all on a single spectrum. I'm imagining human driving at one end of a spectrum and fully automated driving at the other, and looking at what percent of driving conditions each system provides a safety or utility improvement in (so you can see why features like speed smoothing and reacting to nearby cars quickly become relevant to my thinking). But I can see why, judging each system on its own, one would say that Autosteer is less mature at what it aims to do than simpler and more constrained systems are at what they aim to do.
You summarized my take on Autopilot as accurately as one can in a single sentence (thank you for that btw). Like you, I look forward to the day when data is available to resolve competing hypotheses like these. Elon pledged on the last earnings call to release quarterly Autopilot data reports; I'm hoping those will include Autopilot vs non-Autopilot driving usage and their respective highway accident rates, broken down by feature (TACC, Autosteer, TACC + Autosteer, etc). I think that'd be the best way to assess Autopilot safety, as it would control for all other factors. It'd be great to have apples-to-apples numbers from all manufacturers, but I think that will take longer and probably some coordination from NHTSA.
For a computer-driven car with accurate mapping, and hence foresight, it is more efficient to plan the approach so that no braking is necessary. After all, reducing cost requires efficiency rather than speed. Likewise on a long cycle ride I'll try to match the approach and entry speeds by easing-off rather than throwing-away calories by braking.
I also work on self-driving cars. Why would I share technological innovations with another company?
This is an example where companies could put people over profits and share what they’ve learned to keep things safe. I don’t see a lot of research papers (I see none) coming out of Waymo, Tesla, Uber, or Cruise.
Right now, no one really knows the performance of the Waymo system. Millions of miles doesn't mean a lot. I can do billions of miles in a parking lot with no cars or pedestrians. Even millions of miles on road doesn't say anything about the performance of the components.
https://priceonomics.com/volvo-gave-away-the-most-important-...
Why would I share technological innovations with another company?
Because nobody has a real market until some of these problems are solved significantly better than current state-of-the-art?Having some baseline collaboration on common components and safety systems could plausibly move the entire industry towards viability much faster, both on a safety and tech trajectory and for regulatory oversight. It's not a crazy idea.
Competition obviously is a powerful motivator, but sharing tech can reduce costs for everyone, at least in theory.
So how do you compete? I don't know. Along other dimensions, I guess.
There is another aspect of this that I want to bring up: auto-autos should share data with each other and with the surrounding traffic infrastructure in real-time, for safety and for dynamic traffic-shaping. They should be able to cooperatively track pedestrians and non-automated vehicles. The cars and the roads and the signals and something like Waze should all be integrated and cooperating for maximum safety and efficient throughput with low latency. And they should all share experience (training data) of normal and exceptional events across the whole fleet (regardless of manufacturer.) Optimizing across the whole thing will be, uh, optimal. From this POV, non-cooperative behavior (due to the profit motive or just people being people) by any single actor will be seen as a bad-faith move and the network can be expected to route around it one way or another.
[1] Please, let's call them "auto-autos".
There's certainly people who work with particular tech that are pessimistic or optimistic about it.
I think you have elaborated on your true objection, his past skepticism about statistical methods. I don't think that equates to a blanket skepticism. I also refer you to the talk in my original post. He points out that there are breakthroughs and pitfalls that are unanticipated. He outlines specific pitfalls to autonomous driving that he feels no one has adequately addressed.
Does anyone know how self driving cars will react to attempts by law enforcement officers to pull over the vehicle?
1: https://www.quora.com/What-are-the-different-police-uniforms...
Frankly even with local training, you'd still think giving law enforcement devices to stop, restart and redirect vehicles was a minimum requirement.
All of these agents follow a similar pattern of clothing (as I said, combination of similar garnments and colours) and behaviour (placement on the road, gesturing with authority, directly facing the car, etc.). Machine learning algorithms are especially good at recognizing patterns and storing their abstracted form, so it should come as no surprise that understanding what a police officer looks like in abstract is not the main issue of self driving.
> Humans are just a lot better at gauging intention and even simple stuff like parsing the word "police" at an oblique angle
Google seems to understand these intentions well enough, and at a much higher level than mere word parsing. This video is from 2015: https://youtu.be/tiwVMrTLUWg?t=9m5s
You got the car understanding all that happens at a complex intersection at 9'05, understanding what a police car looks like at 9'35, then detecting and reacting to a schoolbus and then parsing a police officer gestures right at the 10' mark. I'd say chances are these are pretty solved situations 3 years later. You can even see some creatures from their "zoo" of patterns for cars & people at 10'35.
Additionally, here is an article from last year: https://www.ibtimes.co.uk/googles-waymo-teaching-police-us-w...
> "When a Waymo car hears sirens, it will automatically pull over, yield, and stop. For example, when a number of vehicles are moving towards the scene of an accident on a highway and ambulances and other emergency vehicles are headed toward it, driverless cars will move aside and give way. Using audio sensors, the cars can detect exactly which direction the sirens are coming from and move out of the way."
Repeating an assertion does not make it cease to be false. A very small handful of pictures you linked to shows a wide variety of coats, vests and shirts of many different colours, all of which heavily overlap with general garment types and colours used in everyday clothing which tend to indicate police only with small and greatly varying trim detailing (and sometimes hats). And is the clothing and trim designed to convey authority? isn't the sort of abstract pattern recognition computers do better than humans, or even at all well. Sure, you could certainly create specific police uniform training sets for every jurisdiction and possibly even cut down false positives in other jurisdictions by geofencing them (so you don't get people stopping in California for commuters wearing the distinctive er... blue shirts and black trousers of the Hong Kong police) but it's a non-trivial undertaking even if there are bigger problems for SDVs to tackle
More importantly, unlike humans evolved to have an intimate understanding of human mannerisms, machine learning has no concept of "gesturing with authority", beyond whether moving human shapes fit very specific patterns within its calibration parameters, and police officers often don't have scope to place themselves in a particular position in order to get the car to understand them.
> Google seems to understand these intentions well enough, and at a much higher level than mere word parsing.
The video shows examples of predicting possible directions of travel of moving road users based on maps and movements (i.e. its fundamental driving model) and a shot of it recognising two arm gestures in an idealised front on positions. Neither fall under the scope of being able to understand how the traffic policemen intends to clear the blocked intersection from his shouts and gesticulations at you and various other vehicles. Humans also don't need to be signalled to go again if the black-jacketed man they've stopped for was actually trying to hail the taxi behind them.
Instead of recognizing the lights or something you could create a communication of some sort where the officer's vehicle provides a key that the car can then authenticate that it's a real police officer making the pull over request.
Heck you could even check with a police department system that the officer is on duty and in that area so a stolen police car or key couldn't be used.
[1] https://www.recode.net/2017/10/15/16472896/alphabet-waymo-se...
In most jurisdictions if there's an emergency vehicle running flashers and/or siren behind you on the same side of the road you're supposed to slow, pull over, stop, then proceed only when the vehicle passes you.
If the emergency vehicle parks behind you then you have effectively been pulled over.
Pulling over safely is practically the first thing a self-driving car team works on. It is very easy to detect flashers and sirens. So... no problem.
Well, except that self-driving vehicles may accidentally be pulled over by firetrucks.
When you hear a siren you're to become alert for the possibility of flashers behind you. You are not supposed to just start pulling over because it may not be on the same road as you and pulling over may block traffic. Imagine if every car in a crowded downtown pulled over every time the drivers could hear a siren. Instant gridlock.
So a siren played loudly on the radio will not cause a rule-following car to pull over, regardless of who or what is driving it. I presume you're talking about siren sounds in music, but...
Installing flashers that produce the same pattern as official police flashers and/or playing a continual siren is impersonating an officer. That's a serious crime.
Fake flashers will probably cause self-driving cars to pull over but they'll also cause humans to pull over. Not a self-driving car problem.
In the future police flashers can have a cryptographic element emdedded in the flash pattern that a self-driving car or a human-driven car with sensors can authenticate but that's an enhancement over the current situation.
It's one of the best-defined situations in traffic because it's precisely the fallback behavior. Detect emergency vehicle behind you, pull over as far as is safe, wait. If a self-driving car can't do that then it's hardly self-driving at all.
The real trouble, which you haven't brought up, is when the traffic is already at a standstill and an emergency vehicle approaches. The soft and gradual scooch-scooch movements that we have to do to clear enough space for the emergency vehicle are a much tougher case.
You can pull over a self-driving car. You just may have difficulty getting past it to an emergency.
So instead of solving this problem it was decided to go forward;abominable. At least the truth came out.
Disclaimer: I do not claim to have full/partial/enough understanding of any AV technology/blockchain/distributed computing/swarm intelligence etc... so my comment is more or less an opinion based on what I think may be interesting, which may or may not be already thought by and discarded for not-enough viability by the AV research.
I mean, if there’s a big blob of something solid in the road in front of you, it doesn’t really matter what it is does it. You still have to not run into it.
It seems that because these poor AIs are relying on LIDAR and even just radar and cameras with Tesla, that they aren’t confident enough in that data to stop if they sense a big blob of something in the road.
If you gave any of these AIs a really high quality 3D rendering of the area around them I would presume they’d do a damn fine job of navigating it and not running into anything. At that point it’s just a computer game.
So either we need better sensors or better algorithms for extracting better 3D data from the existing ones.
It’s not like these fatalities are caused by particularly crazy problems. It’s not that a kid ran behind an ice cream van and the AI couldn’t predict it would run into the road like a human would. It’s just that they make dumb decisions a learner driver wouldn’t make because they can’t see the road properly.
I would bet the farm on Waymo, they realized it takes a long time to build a level 4 autonomous vehicle, so no doubt they were being poached by Uber which all failed.
Likely the problem is one of numbers. The sheer amount of data, and the traffic data Google has access to, all of this adds to a superior safety experience.
Meanwhile a level 2 masquerading as level 3 autopilot should be up for some serious scrutiny, especially if it's true that there appears to be some issue with the autopilot on the Tesla.
I agree with the pessimists: driving is 99% a mindless activity that even a mediocre AI will handle soon. But the last percent requires not just a better AI but a human. At least as long as it drives with other people in an environment designed for people.
If we put aside creation of unemployment, putting limits on what human drivers will be able to do, and similar dystopian outlooks, what are the benefits for the masses?
People who cannot drive will be able to use cars as people who can. Is this good? Are interesting places on the planet going to have the same fate as Internet did, when it transformed from elite audiences in 90s to tragedy of commons today?
Logically, this doesn't make any sense, but taking control away from people leads to some psychological hurdles.
You can't make a robot that goes out in public and kills random people. You just can't do that. Okay?
Q: "What if the robot looks just like a car and there's a person inside the robot watching TV? Can it kill random people then?"
Still no.
Q: "But people do that all the time! Tens of thousands of people die or are maimed by traffic collisions every year! My robot can't join the fray?"
Still no. It's insane and horrible that we set up a death and mayhem lottery and that we force everyone-- children, old people, pregnant ladies, folks in wheelchairs, ev-er-ee-one -- to play it whether they want to or not. That's a bad thing we shouldn't do. But it still doesn't make it okay for you to make a robot that goes out in public and kills random people.
If you make a robot, send it into the world, and it kills someone, you are a murderer and you should go to jail, even if your robot looks like a car and there's a person riding inside it.
- - - - -
We could make a self-driving golf cart that never went fast enough to be able to injure people and it could take my mom (who has dementia and can't drive or ride the bus on her own anymore) to the doctor and back safely. We could build that today, with existing technology, there's a market for it, and it wouldn't kill anyone.
Self-driving cars are a fetish that distracts from solving real problems! (One day that won't be true, let's not kill too many more people until then, hey?)
- - - - -
Humans drive really well. Like really really crazy good well. When I first realized how well people drive it made me consider that Guardian Angels might be a real thing. But then I learned more about how the motor cortex worked and some of the uncanniness faded.
We should be so lucky as to have robots that drive as well as we do.
In the meantime, the industry should concentrate on incrementally automating traffic and stop trying to bite off more than current technology can chew.
What we're seeing now is hubris driven by ego and greed. And it's killing people.
Notice it is not the average human on the road right now, but the average human assisted by the same magical driverless technology that is developed.
When we can get rid of recycle bins, because we've finally figured out how to get our robots to sort our trash for us!
There are some practical reasons for recycle bins, or at least for separating out paper. Paper can get damaged if mixed with liquids or other foods/compostable material, and harder or not worth recycling. Keeping it separate from the very beginning increases the ability and efficiency of recycling => less dead trees.
> ...sophisticated trash-sorting robots are now turning up at recycling plants across the nation.
> The robots — most of which have come online only within the past year — are just as accurate as human workers and up to twice as fast.
https://www.nbcnews.com/mach/science/how-robots-are-reshapin...
The future is coming on strong.
"I tell adult audiences not to expect it in their lifetimes. And I say the same thing to students"
"Merely dealing with lighting conditions, weather conditions, and traffic conditions is immensely complicated. The software requirements are extremely daunting. Nobody even has the ability to verify and validate the software. I estimate that the challenge of fully automated cars is 10 orders of magnitude more complicated than [fully automated] commercial aviation."
- June 2015, Steve Shladover, transportation researcher at the University of California, Berkeley
https://www.automobilemag.com/news/the-hurdles-facing-autono...
"While I enthusiastically support the research, development, and testing of self-driving cars, as human limitations and the propensity for distraction are real threats on the road, I am decidedly less optimistic about what I perceive to be a rush to field systems that are absolutely not ready for widespread deployment, and certainly not ready for humans to be completely taken out of the driver’s seat."
- March 2016, Mary Cummings, director of the Humans and Autonomy Laboratory at Duke
https://www.commerce.senate.gov/public/_cache/files/c85cb4ef...
"With autonomous cars, you see these videos from Google and Uber showing a car driving around, but people have not taken it past 80 percent. It's one of those problems where it's easy to get to the first 80 percent, but it's incredibly difficult to solve the last 20 percent. If you have a good GPS, nicely marked roads like in California, and nice weather without snow or rain, it's actually not that hard. But guess what? To solve the real problem, for you or me to buy a car that can drive autonomously from point A to point B—it's not even close. There are fundamental problems that need to be solved."
- September 2016, Herman Herman, director of the Carnegie-Mellon University Robotics Institute
https://motherboard.vice.com/en_us/article/d7y49y/robotics-l...
This isn't new though -- "thinking machines" have captivated audiences for millenia. See the Antikythera mechanism [1], the Turk [2], and so on. The ability to replicate the capabilities of our own brains is intoxicating -- it finally signals that we, homo sapiens, understand our own minds well-enough to recreate their abilities at will.
[1] https://en.wikipedia.org/wiki/Antikythera_mechanism [2] https://en.wikipedia.org/wiki/The_Turk
Real AI would literally be the final frontier, because at that point, all the scientists could quit their jobs. The AI could replace them.
But real AI is a lot different than what everyone is selling as AI these days, which is essentially a hyper-glorified generalization of linear regression.
The autonomous cars only drive when it's 80 degrees out, sunny and on predetermined paths? Still welcomed.
Although I suppose the difficulty limits the market enough to make investment in such a scheme uncompetitive. Perhaps this is what Musk is hoping to get around that with his tunneling idea.
Let people drive manually to predetermined locations, let's name them a "station". Where the "AI" takes over and lines up cars on predetermined routes, let's name them "tracks". The AI will control the car on the "track" up until the nearest "station" to the destination. From there the driver will manually continue to her destination.
Waymo has been developing the technology for 9 years, and have accumulated nearly 8 million real world test miles in that time.For the last 18 months (or so) they have focused their testing in the Chandler area, but are not yet ready for a commercial launch.
For every new area they head into they need to solve specific problems at specific intersections. The vehicles are not yet validated for a full range of weather conditions. There is a huge amount of preliminary work that goes into preparing an area for commercial operations.
Developing an autonomous vehicle that can go anywhere as well as a human might just be 10 orders of magnitude than for commercial aviation, but what Waymo has is enough to disrupt.
- Irving Good
"Within a generation, I am convinced, few compartments of intellect will remain outside the machine’s realm - the problem of creating ‘artificial intelligence’ will be substantially solved"
- Marvin Minsky, 1967
Can we stop listening to him now?
I'm joking, he's an expert of course, but seriously that's a pretty dumb view. It's exactly the sort of thing I expect from a SV "disruptor" type.
> “Rather than building AI to solve the pogo stick problem, we should partner with the government to ask people to be lawful and considerate,” he said. “Safety isn’t just about the quality of the AI technology.”
Just crazy.
These people just really do not seem to care if they kill people. They are engaging in foolish behavior rushing ahead with a technology that's not ready and thinking they can just paper over the gaps with laws and patches.
when, while and do are just if and goto.
alpha go is all just if and goto. I'm not sure what you're looking for or alluding to.
Is there some other operation that isn't just if and goto? because i think any function you come up with, i can just make a big table of inputs that result in specific outputs.
Heck, decrement and jump if zero is enough. I'm not convinced at all that specific operations are limiting us somehow. Could you elaborate?
we currently lack the ability to recreate a brain-like entity, but the subtext that i am reading here is that the complexity of the brain is such that accurately modelling a brain in mathematical terms is impossible. the "brain-as-computer" model may not be accurate, but everything that exists can be expressed in mathematical (and therefore compute-able) terms.
i doubt that cyberbrains will run on anything that we recognize as a general-purpose cpu. gpu micro-architecture is already a significantly more efficient option for performing nn computations. as our grasp on this stuff improves, more specific silicon is being developed to make it even more efficient.
This is not very complex and accurately models neurotransmission. What's missing here is the vastness of connections from a particular neuron towards thousands or more other neurons, but the inherent function is definitely not complex.
* weight being either 1 if you adopt a continous modelization (multiple serial input provide multiple serial output) or a float if you prefer the discrete modelization (sum of input to sum of output)