Before someone says "but benchmark doesn't reflect real world..." please name what metric you think is meaningful if not benchmark. Token consumption? OpenAI/Anthropic revenue?
This will never change because you can only use an LLM to generate code (or any other type of output) you already know how to produce and are expert at - because you can never trust the output.
W.r.t code changes especially small ones (say 50 lines spread across 5 files), if you can't get an agent to make nearly exactly the code changes you want, just faster than you, that's a you problem at this point. If it maybe would take you 15 minutes, grok-code-fast-1 can do it in 2.
If you're creating basic CRUDs, what on earth are you doing? That kind of thing should have been automated a long time ago.
It is true that LLMs make it easier to build these kind of things without having to become a competent programmer first.
Job satisfaction and human flourishing
By those metrics, AI is getting worse and worse
AI is able to speed up the progress, to give more resources, to give the most important thing people have - time. The fact that these incredible gifts are misused (or used inefficiently) is not the problem of AI. This would be like complaining that the objective positive of increased food production is actually a negative, because people are getting fatter.
I could not care less about AI's satisfaction in anything
1. Is there steady progress in AI?
2. What example do you need? In every single benchmark AI is getting better and better.
3. Job satisfaction and human flourishing.
Hence my answer "AI is very satisfied in doing the job, just ask it". It came about because of the stupid comment 3, which tried to link and put a blame on unrelatable things (akin to refering to obesity when asked what metrics make him say that agriculture/transportation have not made progress in the last 100 years) and at the same time anthropomorphed AI. I only accepted the premise and continued answering on the same level in order to demonstrate stupidity of their answer.
I was answering user "lomase".
The figures for cost are wildly off to start with.