Hacker News Reader

Comment by WoodenChair | Hacker News Reader

Just a note that this is not novel. Automatic analysis of chess games built on traditional engines has existed for a long time. Without using stockfish as a sidekick, this wouldn’t be interesting because of the poor play of LLMs, however having an LLM enhance the commentary is interesting and I suspect has already been done by chess.com for years.

View on HN

I'm an ok chess player (roughly OP level) and slightly more experienced claude code user.

I tried to use claude to analyze my games using stockfish - this is not a problem claude is good at.

I spent few hours (however admittedly around opus 4.8) with claude on this and it was unable to use stockfish in any useful way.

I think if the skill created by OP works then it's a real contribution. I'll give it a try.

Thanks for trying it out! I'd be happy to see how it goes for you and compare our implementation notes if the analysis you got is not too bad.

There is a massive gap between computer analysis and teaching though. And its larger the less you know about chess.

Also dont forget that stockfish and agents are not alternatives. An agent can use stockfish to help players learn.

This what I think too. I also think there are much more refined approaches than the one I tried here. From a cursory look, I saw there are both scientific litterature on the subject of mixing llms and tools like stockfish and some dedicated closed platforms that put that into action.

Let's make clear that I did not spend much time on this project. Ideally I would have tried to put other models into the mix, like maybe Maia to better see the game from a "real player" eyes and pinpoint where expected move and stockfish moves differ.

Anyway, to me, it's good enough to be usable and shared.

Reply on news.ycombinator.com