https://blog.codinghorror.com/the-2030-self-driving-car-bet/
https://blog.codinghorror.com/the-2030-self-driving-car-bet/
Waymo is already there, in at least 2 cities but not all weather conditions. Expanding to 10 cities and all weather conditions in the next 6 years sounds more than plausible.
I had sided with Atwood (skeptic) but now it seems like Carmack "has already won".
At least in SF, I haven't seen a day where Waymo refused availability for the weather. Rode it all over town in the rainstorms this weekend, and found it a little jarring to see the windshield covered in rainwater cause the computer doesn't GAF.
If it doesn't need to handle snow to win this bet, it seems it could handle Seattle-tier rain already.
Situations that come immediately to mind:
- Driving in the hurricane lane on the shoulder during an evacuation
- Reversible lanes and streets
- Sizing up an icy hill and figuring out whether it's safe to keep going
- Ferries
- Knowing a baseball entering the road from behind a parked car will probably be followed by a child
- Understanding traffic police, sign turners, "follow me" trucks, etc.
[0] https://www.sae.org/binaries/content/assets/cm/content/blog/...
I actually see the main thing right now that would mean this bet is "not currently won by Carmack" is that they are not officially offering freeway access in its commercial product: https://waymo.com/blog/2024/01/from-surface-streets-to-freew... But this seems minor, and I can't imagine it taking more than 2 years to allow freeway driving in multiple metros.
I can't fathom what would need to happen to derail this particular bet from being satisfied in Jan 2026 let alone Jan 2030.
(Note: if it wasn't for Waymo, I think this timeline would be much less clear. Tesla/Cruise feel much less predictable.)
Waymo has level 4 taxis in two US cities and is running tests elsewhere too. The usual reaction from the "This can't be done because somehow driving a motor vehicle is a uniquely human ability" people in those cities seems to be head-in-the-sand refusal to believe. The good news is that if they choose to believe a Waymo doesn't exist and step in front of it, it'll probably brake politely to a halt like they're any other asshole.
Level 5 mostly requires more range. I don't think this bet is a sure thing, but it's certainly possible that Waymo's reason you can't go from say New York City to Birmingham Alabama in 2030 is something that sounds like a taxi company reason rather than an "Our AI can't do that" reason.
I can confirm that in my experience, Waymo handles these kinds of situations fine. Better than many humans in SF seem to, ha! Compared to my past experiences with Cruise, where the car would become instantly paralyzed at the sight of flashing yellow lights, so it could phone home for human intervention.
Icy conditions seem like a big open question to me. As a human driver, there's a big difference between driving on a road slick with rain and a road slick with snow and ice..but maybe there is not much of a difference to a self driving car? Certainly, other humans on the road behave differently in snowy/icy conditions than in rainy conditions, and the self driving vehicle needs to share the road with them.
Seattle-tier rain probably isn't what you think. But if it operates in Seattle, it does need to handle snow --- at least enough to recognize it's snowing and find somewhere flat to chill out until the roads become drivable again.
I find it odd that a self-driving system only works in 2 cities. Is the model overfitted to only know some specific locations? How does that work?
Like, I can understand it struggling in snow or heavy rain. I can understand it struggling if the lines on the road are faded. But given a well-marked intersection in one city, and another well-marked intersection in another, why would it fail in one?
Yes. Every inch of drivable area is LIDAR-mapped. The opposite of the antifragile approach, which is harder to execute but much more durable.
If this is true, then I find it incredibly absurd that people would try to act like Waymo is farther than Tesla in self-driving tech.
Tesla is trying to make self-driving work everywhere without pre-mapped data beyond what you'd get from Google Maps.
A few weeks ago I saw a video of someone making his first Waymo ride, there was some construction site and the vehicle stopped and waited for some human to take over control. They are not there in any weather and given that the last 10 % of a problem have a tendency to consume 90 % of the effort, they might have a long road ahead even if it already mostly works.
You seem very confident that "against" will win after only two years have elapsed since the bet was made, when there are still EIGHT YEARS of time remaining on the bet.
Waymo is already at level 4 at least on surface streets, and they claim 99.4% uptime in rain, high winds, and thunderstorms during last winter. [1] They're testing highway service in Phoenix now.
There might be a debate about the word "all" for the distinction between levels 4 and 5, but Waymo has six years to erase that doubt.
[1]: https://waymo.com/blog/2023/08/the-waymo-drivers-rapid-learn....
AFAIK, that's what L5 means.
By "major cities" we mean any of the top 10 most populous cities in the United States of America.Level 5 fully autonomous would mean the car is able to drive in icy and snowy conditions (adjusting how it drives based on traction), it would be able to respond to verbal commands from construction workers, and it would be able to detect when a hazard in the road prevents it from continuing, plan a new route, and detour.
There isn't much incentive for Waymo or its competitors to create level 5 autonomous cars when there is a plenty large market in places where there is good weather and good signal for an employee to tell the car what to do if necessary.
Here's how you can tell so that you don't get confused as easily in future. Level 3 cars can require the occupant to drive the vehicle, "When the feature requests: You must drive the car". Waymo even offers service to people who cannot drive whether that's legally (they aren't licensed) or physically (blind people can use Waymo but can't drive a car). They are simply not required to take over driving.
What does it mean exactly? Because this can mean everything really. I mean you could guide decision making process by "now press break, now reverse and...", is it still driving?
And he's clearly been optimistic most his life, and it's paid off a number of times.
And self-driving has progressed further and faster than I have thought it would, though I don't think we'll get Level 5 by 2030.
The point was he seems to consistently grossly underestimate the difficulty of problems outside of his domain expertise.
> The point was he seems to consistently grossly underestimate the difficulty of problems outside of his domain expertise.
Carmack made 3d games and game engines. I don't think VR was outside his domain of expertise.
And for the self driving one, that bet is still on
Facebook's VR plan seems to hinge on being "even more ubiquitous than mobile" <https://officechai.com/learn/mark-zuckerbergs-email-explaini...>, which is a level of constant use that 3D games don't really have.
I am not a VR or 3D game expert, but even I can list other key differences. I bet you can too if you try. I think those are reasons to think VR is not really the same domain. I am curious what you think.
He's now working on a startup in the AGI field, which will also probably go nowhere for him.
He gets to work on things that excite him - what a place to be in life. We can all envy that - but he's not very good at gauging problems and consistently underestimates their difficulty/time-to-market.
> It requires engineers to ship high FPS and low lag to prevent nausea to a degree unheard of for PC gaming.
This is very much Carmack's speciality, and why his focus was on making mobile VR happen [0]. There are very few people who can outperform him at that, and most of them worked for Oculus :-)
[0]: https://www.gamedeveloper.com/design/q-a-carmack-reveals-the... (this predates the Quest, but it should give you an idea of the problems he was tackling)
VR is not _at all_ outside his domain expertise.
We see this often with engineering types, many of us included. Vastly underestimating difficulty of challenging problems and naively believe they're simple to solve.
There's a wait-list you have to join, but anyone can download the app and get in line.
Pick an optimal path for each metro, only operate on good weather days, roll out nationally.
FSD12 appears to be a major advancement. https://twitter.com/WholeMarsBlog/status/1750448446790922634
Ignoring the safety path, this other issue just scale. Manufacturing the cars would be a big problem. Getting a ton of them on the road is another. I wonder if all those sensors that the car uses could ramp up to a national level in a year.
I've been in the Waymo beta for a couple months now. At peak times, it's more expensive and slower than an Uber simply because there aren't enough cars on the road.
Also, "optimal routes" tend to quickly become suboptimal due to traffic, road closures etc.
In Texas, a light breeze takes out the entire state, whereas in Canada, most of our workforce is expected to at try to continue working after a 20 inch snow dump the night before.
I hope you can see how there’s reason to being pedantic.
If level 5 is all conditions human drivers do regularly for day to day activities, 2030 is an idiotic bet and anyone not living in a bubble could see that.
Does the city own a fleet of snowplows? Does it keep massive stores of road salt available? Do schools and offices even have heating systems at all?
On the other hand, driving carefully on snow and ice is a skill in itself that has to be learned. And in snowy places I do know people who simply don't drive in some conditions because they're well aware they don't have those skills, even growing up there -- while others enjoy the challenge. So that part is a fair question of which humans we're talking about when we talk about human-level driving skill.
> So that part is a fair question of which humans we're talking about when we talk about human-level driving skill.
These California-based companies assume everywhere is California, and still want to release those cars internationally.
Whatever a human driver with a non-commerical license does on a day to day basis is a good measuring stick.
What about a 3" snowfall? That is a more common event, and a much larger number of human drivers stay on the roads despite the snow.
Yes. It is intended to be so. Because being pedantic is now how you define these levels.
The ultimate goal is to run a large fleet of robo taxies wherever possible and Level 5 tech can do that everywhere on globe. One can get pedantic and ask if this would work in Antartica or on Dead Horse Bay or whether driving in sand dunes of Saudi Arabia is possible. But the folks who are trying to pedantic wont be happy with any definition either here.
This doesn't mean that it needs to magically cross destroyed bridges, as the popular culture definition often implies.
It adds: "However, there may be conditions not manageable by a driver in which the ADS would also be unable to complete a given trip (e.g., white-out snow storm, flooded roads, glare ice, etc.) until or unless the adverse conditions clear. At the onset of such unmanageable conditions the ADS would perform the DDT fallback to achieve a minimal risk condition (e.g., by pulling over to the side of the road and waiting for the conditions to change)."
I used Waymo in San Francisco, and to my not-expert eye, it did perform very well already.
Yeah. That sounds right.