Hacker News Reader

It looks like it played a fully legal game of chess with one exception, it said "rxd1+" (Rook takes D1 with check) instead of "rd1+" (Rook to D1 with check) on move 29.

I would say this did a really good job of playing chess. It moved the pieces consistently and traded pieces when required.

This is worlds away from the frontier ~1 year ago where models would hallucinate pieces into existence.

View on HN

You can still see undercurrents of its old self, once I pointed out the illegal notation it hallucinated prior illegal moves. But I agree, it's leagues apart from prior iterations. It also knew thematic moves in the opening. But whenever it needs to play concretely rather than "I know so-and-so is a good move in these types of positions" it crumbles.

Agreed, move selection was not great. Notably, it should not have allowed nxe7+.

However, the pawn was defended by the queen and it took a forced queen trade to unlock the move.

I have seen much worse blunders from human players. And, I have made much worse blunders.

Would you tell a human that just tried doing an illegal move that they did "a really good job of playing chess"? The probability for such mistakes is greatly reduced but still far from negligible, which proves the point that guardrails are needed.

Reply on news.ycombinator.com