> if the constraints and tests are reasonably well specified.
if they are, then why would a human be so slow? You're not comparing the same situation.
if they are, then why would a human be so slow? You're not comparing the same situation.
In that time the LLM has made a change, ran tests, committed, pushed, checked that the CI build failed, looked at the CI logs, fixed the issue and the PR is now passing.
They are certainly slower than me at text generation.
Can you beat this one? https://chatjimmy.ai/
(It is to be fair running a pretty trash model, a quantized Llama 3.1 8B from ~18 months ago)
The difference comes in confidence that the solution works and can be maintained in the future, but in terms of purely making the decisions and applying the changes an LLM is faster when it has all the required infos available