1,505 karma · joined March 23, 2016
They also used Astra for the coding, which they can't get on a $10 subscription. And then there's the actual training cost.
Your close following distance example doesn't show anything. A normal braking event on the highway doesn't require a fast reaction. If you're driving 100 km/h and you're following 1.5 seconds behind the car in front of you (about half the recommended following distance) and they brake to 80 km/h, you have about 9 seconds to slow down or switch lanes. That's plenty of time.
The risky scenario is if the car in front of you has to do a full, hard emergency stop and you're following too closely. That's rare, and collisions are common when it happens.
If you know the car in front of you is going to brake because you can see the traffic ahead slowing down, that's not fast reaction time. That's just you seeing cars slow down and reacting at a normal speed. An AI has just as much time to react to that as you do.
There are a lot of reasons people could sometimes react faster (for example, if they anticipate the hazard, or if they're just above average in reaction speed), but one to two seconds is the reaction speed we find most of the time.
The fastest human reactions aren't to unexpected road hazards. We have a much faster reaction speed in tests where you just have to click the mouse each time the screen flashes. Our reactions are fastest when you know in advance the event is about to happen. But this isn't relevant for road safety.
In humans, it's about 200–250 ms for a visual cue where you already know how to respond and you're ready, but you don't know exactly when it'll happen. It can be a fair bit longer if you need to identify what you see and choose how to respond. Typical perception to reaction time estimates for drivers when there's an unexpected hazard on the road are 1-2 seconds.
I don't think you can guess more precisely than an order of magnitude from trying each once on one task.
a) There's zero evidence of them doing so
b) Some models released before the car wash problem was discovered would consistently get it right
c) Hardcoding it is pointless. No one is seriously asking that. It's just a trick question. Hardcoding one trick question won't fix its weakness at other simple trick questions.
d) Since it went viral on the internet, the next time they updated the knowledge cutoff, the LLM would likely be aware of the trick. It will fix itself without the labs doing anything special, even assuming the new models weren't smart enough to naturally figure it out.
If we go with your interpretation instead, then sm-silversight simply misread the comment they replied to and their post doesn't follow. No one doubted OP felt sincere about not wanting to read AI.
I also get this a lot, but almost always with "and for a stronger reason than you said", which makes it sound more like it's reinforcing me than one-upping me.
Looking through my recent transcripts, I found this pattern 12 times, with every time using "and" instead of "but".
Eg:
- "Confirmed, and it's worse than a pause quirk."
- "I think the ban is right, and it's a stronger idea than what I'd proposed."
I did find one instance with "but", but it was a genuine disagreement rather than 1-upping or presenting strengthening evidence: "I would cap it, but for a different reason than fairness."
OpenAI's proof is substantially different and I don't think anyone has claimed otherwise. The accusation is that they used the same avenue of attack, and it's an uncommon one, and that makes it suspicious that they may have taken the idea.
1. I didn't say LLMs have made any breakthroughs in math, not because they haven't, but because it's irrelevant to my point. The parent comment is using the same argument academic research opponents have long used against research. The vast majority of research fails to meet their bar. How would your daily life be different if we had no humanities papers published since 2023? Or math?
2. You can google this in 10 seconds and see a dozen results in math. This is not a good-faith demand.
Most of the biggest breakthroughs in mathematics, breakthroughs that win Fields Medals like sphere packing in dimensions 8 and 24, have no applications in everyday life. Probably the only new mathematics results that people notice affecting their daily lives are the ones that enabled AI.
Nevermind mathematicians. What about the millions of programmers? Are they all hype too because people pre-2023 were griping on hn that software is buggier than ever and people are still using the same operating systems as always? Why couldn't the 30 million human programmers make something better in the past decade?
You set your bar so high that all the world's human experts in math and programming combined would fail to meet it.
The top LLMs in 2024 were Sonnet 3.5 and GPT 4o. You couldn't have expected those much weaker models to be making breakthroughs in math. The models that are making breakthroughs haven't been around very long.
We don't know what was going on inside the closed source GPT models, but this paper investigated on some of the open-weight models and found it's not due to tokenization: https://arxiv.org/abs/2604.00778
Meanwhile most humans fail to correctly answer how many f's are in the sentence, "Finished files are the result of years of scientific study combined with the experience of many years.".
The test wasn't made to accurately measure IQs that high.
I'm not saying people who already have a dishwasher will throw it away. But a robot makes installing a new dishwasher much less tempting.
At my utility prices, it costs about 5¢ to hand-wash one serving (plate, pan, glass, utensils, and a bowl) with running water. That's not nothing, but it's dwarfed by the energy use of using the oven and the supply-chain energy and water use of the food if it includes meat.
People will casually waste 10x that energy without a second thought when they don't need to just because it's convenient, or because they're used to doing things that way.
The dishwasher looks more unfavorable if you're considering installing one in a small apartment or condo. Apart from the cost of the dishwasher, you need space to install it, and more cupboard space to keep more dishes, glasses, etc. For an extra 4¢ per person-meal, having your robot do the dishes buys you the convenience of skipping all that and having all your dishes clean and ready all the time.
The parent commenter was trying to draw some insight from LLMs being classifiers that wouldn't apply equally to everything else.