we live in a wholly unoptimized world because the available resources have been so high, while the benefits of optimizing have been so low. that has flipped now and there are tons of low hanging fruit to optimize.
I agree that benchmarks would be great, but thats only relevant to this one topic, not the overall agentic coded pull request concept itself
A PR without evidence it works and expectations for the benefits using the new feature would bring is kind of worthless.
If it works in one case that doesn't mean it works consistently or well in the general case
I've made lots of things with Claude Code that just work... until I do things in a slightly different order and the whole thing explodes
People who do this want the fun part of pretending they’re implementing a feature without actually putting in the hard work it takes to make something for real.
They want the repo maintainers to do all the hard, boring parts while they have fun. As if maintainers of open source projects don’t have enough thankless work on their plates. Good luck with that!