I don't know what you are trying to say with your post. I mean, if two persons feed their prompts to an agent and while one is able to reach their goals the other fails to achieve anything, would it be outlandish to suggest one of them is using it right whereas the other is using it wrong? Or do you expect the output to not reflect the input at all?
That's a problem you are creating for yourself by believing in magical nonsense.
Meanwhile, the rest of the world is gradually learning how to use the tool to simplify their work, being it helping onboard onto projects, doing ad-hoc code reviews, serving as sparring partners, helping with design work, and yes even creating complete projects from scratch.
For example, I was working on the same kind of change across a few dozen files. The prompt input didn't change, the work didn't change, but the "AI" got it wrong as often as it got it right. So was I "using it wrong" or was the "AI" doing it wrong half the time? I tried several "AI" offerings and they all had similar results. Ultimately, the "AI" wasted as much time as it saved me.
Are they doing the same thing? Are they trying to achieve the same goals, but fail because one is lacking some skill?
One person may be someone who needs a very basic thing like creating a script to batch-rename his files, another one may be trying to do a massive refactoring.
And while the former succeeds, the latter fails. Is it only because someone doesn't know how to use agentic AI, or because agentic AI is simply lacking?
* strictness of the result - a personal blog entry vs a complex migration to reform a production database of a large, critical system
* team constraints - style guides, peer review, linting, test requirements, TDD, etc
* language, frameworks - quick node-js app vs a java monolyth e.g.
* legacy - a 12+ year Django app vs a greenfield rust microservice
* context - complex, historical, nonsensical business constraints and flows vs a simple crud action
* example body - a simple crud TODO in PHP or JS, done a million times vs a event-sourced, hexagonal architecrtured, cryptographical signing system for govt data.
Bad with regex or things involving recursion.
Also bad at integration between modules. I have not tried to solve this yet, by giving documentation of both the modules.
Also model used impacted. To understand java code it was great.
I first ask it to generate the detailed prompt by giving a high level prompt. Then use the detailed prompt to execute the task.
Java code size Upto 20k loc is fine. Other wise context becomes big. So you have to do module by module.
I believe to have a discussion maybe someone has to take an open source code example and then say it doesn't work. Other people can then discuss and decide.
Overall happy with gpt5 and claude code.
Edit:updated bad at integration
You should first draft the interface and roll out coverage with automated tests, and then prompt your way into filling in the implementation. If you just post a vague prompt on how you want multiple modules workinh together, odds are the output might not met implicit constraints.
For LLMs to be effective, you (or something else) needs to constantly find the errors and fix it.
===
In equilibrium, the probability of leaving the Success state must equal the probability of entering it.
(Probability of being in S) * (Chance of leaving S) = (Probability of being in F) * (Chance of leaving F)
P(S) * 0.01 = P(F) * 0.20
P(S) * 0.01 = (1 - P(S)) * 0.20
0.01 * P(S) = 0.20 - 0.20 * P(S)
0.21 * P(S) = 0.20
P(S) = 0.20 / 0.21 ≈ 0.95238All this math is useless. Use your brain. The entire point I’m communicating is that it’s not a given that it must become less accurate. There are multiple open possibilities here and scenarios that can occur.
Doing random math here as if you’re dropping the mic is just pointless. It doesn’t do anything. It’s like making up a cosmological constant and saying the universe is collapsing look at my math.
You still have to have a hand on the wheel, but it helps a fair bit.