redox99

Your prompts are probably very underspecified then. Frontier models one shot the majority of my prompts. UI is kind of the exception, there I do have to ask for a lot of tweaks.

I think pi handles it better

Anything you do right now? A typical 10 minute prompt "simply" becomes about 7 hours long. (40t/s vs 1t/s).

I hate so much how every food menu is now AI slop. I wish that was outlawed under false advertising.

At 1t/s it's still faster than humans for a lot of tasks, basically doing overnight what could take humans half a week. Plus you can always parallelize.

The amount of goalpost moving is insane. "Yeah it can solve Millenium problems, but can it do it with nothing more than a one sentence prompt?"

Also there are proofs where the only human steering was "keep going".

Fields that allow verification, like math, will far surpass human level because they don't need human data for training. It's exactly the same as with Chess

The stochastic parrots have done it again!

Mistral models are way worse than Chinese models in the real world. It's not benchmarks.

Yes and no. It means the system is pushed away from a macroscopic theory into one where molecular effects matter. So it's not that you'd get infinite velocities in the real world, but you might get significant real world behavior that is not described by the macroscopic theory.

Kinda surprised they didn't get a single sale for some of those. I think it probably looked too much like AI slop so customers refrained.

I use the $100 which currently doesn't have the 5h limit.

The 5h limit hurts the most on the $20 plan because the limit is already very small (5h is ~15% of your weekly).

5h limits are awful. It means it is literally unable to complete a large task.

A better approach if they want to balance the load is having higher usage or lower usage consumption at different times of day.

It is (uses way less tokens)

The problem is not photorealism. The SVG is outright dumb, its on the wrong side of the table, the table has fucked up geometry (its tilted) and many more minor flaws.

Images from their X account

They realized Astra having the same score as Sol was silly so they rushed to update the index so it fits what people expect.

The old index was clearly bad (Astra is way better than Sol) but it's also unscientific to tweak it like this.

Those two you mentioned completely demolish opus 4.5. It's not even close. I'd say they are between opus 4.8 and opus 5. And better in some tasks.

4.5 became useful for one shotting large features.

LLMs were useful for coding ever since GPT3 (copilot), and sonnet 3.5 for agentic coding.

Yeah 5 was very underwhelming.

The jump from 3.5 to 4 felt gigantic to me back then.

GPT 5.0 did feel underwhelming though.

I hate the term "AGI" but IMO Fable, 5.6 Sol, et al. were already AGI.

Definitely not Google, countless horror stories and infamous for killing stuff. OpenAI is still serving GPT 3.5 turbo as far as I remember.

You can ask 100 people and they'll all give you a different list. It's subjective.

I think a less personal ranking would be, as a business owner, which of those providers is more dependable? As in, you don't care about evil, just your stuff working. I think maybe OpenAI?

Google, Zuck, Sama, Elon, Amodei (in no particular order).

They all suck. Pick your poison.

No because the frontier keeps advancing very fast.

Yeah for sure. Easily 10x that. And obviously we're talking just output tokens. I was mostly just pointing out a theoretical lower bound.

> I think it's roughly possible for any piece of software.

Still not possible for games (many people are attempting it on X).

It's definitely getting better with every new model and it's just a matter of time before they can actually do it.

Fable 5.1 is quite strong

https://x.com/loktar00/status/2095192155086057978

(that's just a main menu, other people are attempting entire games which is way more difficult of course and results much weaker)

Obviously the agent would need to build a very extensive test setup for Paint.NET, a lot of it with computer use or something similar.

Opening the same files, performing the same clicks, etc should output the same on paint.net and the clone.

700k LoC of human written code is probably like 2M LoC of LLM "slop". That's probably around 8M tokens. Assuming a single fable agent that one shots the new source code at 30 tok/s, that's 74 hours. Of course it needs wayyy more tokens because it wouldn't one shot it, plus the reasoning tokens. Generation speed would be faster because you'd have many simultaneous agents though.

Bun rewrite took 6 days of coding and was a similar number of LoC, so I think a couple of weeks is definitely reasonable, although you probably need more than 5 Claude subs.