Comment by ekinertac | Hacker News Reader

Comment by ekinertac | Hacker News Reader

Author here.

To be upfront about what this is: I'm not a Rust developer or a PHP internals person. This is an experiment in whether the "point the AI at the original project's test suite" methodology (the way Bun was driven against real-world suites) holds up when the human can't review the code. The oracle is php-src's own .phpt corpus, ~22k tests I didn't write. Current honest score: 3,844 passing (17.4%), with a realistic ceiling around 40-45% since the rest tests C extensions (GD, curl, intl, etc.) that are out of scope.

"Renders WordPress" means: fresh install completes into SQLite, the front page renders with real posts, a real theme and /wp-admin/ renders without issues. The REST API is untested, and it's currently ~55x slower than PHP on the front page (a bytecode VM is in progress, micro-benchmarks are already at 1-3x of PHP 8.5).

The scoreboard auto-generates into the repo after every run, whether the number went up or down.

Happy to answer anything.

Will you answer questions yourself, or will you simply pass on what your LLM of choice writes for you?

Edit: On further inspection, the blog design, the blog build, the blog articles and even the anecdotes used in the articles are entirely Claude generated.

Stop being so lazy. Get Claude to do something interesting and use your own intellect to assess and challenge the work in your write up. Or the other way around. Inject some amount of human work, at least. Otherwise, what's the point in sharing?

> will you simply pass on what your LLM of choice writes for you?

But it will be as least 17% correct!

The "honest score" is the most annoying claudism of the comment, with the short disjoint sentences a close second.

It was "I need you to sit with:" that immediately made me close the article. I like LLM programming, but I really don't understand why so many people just post LLM-generated articles. What did the human even do at that point, press the start button?

well, thanks for the tips on how to run my own blog :) but the post already tells you this, the last paragraph literally says an LLM drafted it and i edited it. the whole project is an experiment in what a non rust/php guy plus AI can ship, so hiding the AI in the writing while disclosing it in every commit would be a weird place to draw the line.

This is a pretty cool experiment. Thanks for sharing!

thanks! the devlog in the repo has the longer war stories if you enjoy this kind of thing.

Compare with FrankenPHP?

I'm not there yet but I'll run the benchmarks against FrankenPHP and include it in the project when we get at least %60 test parity.

Reply on news.ycombinator.com