Hacker News Reader

Katago (and Leela) and “blue dot” is changing human vs human games too. Interestingly enough, I will say this about Katago: you can consistently beat it with +6 handicap. I don’t think you can say that about pro players.

View on HN

Yeah this speaks to the fragility of current machine learning techniques. It wasn't trained to play handicap go, so it's quite bad at it.

Similar to what is being called hallucination in LLM area

How would a pro fare that never played handicap go ?

Probably the same way top 10 GMs do giving Queen odds. They’ll still stomp most lesser players.

Nit: KataGo does train on handicap games up to 5 handicap stones. In the KataGo write-up "Accelerating Self-Play Learning in Go" from 2020, Appendix D says that KataGo trains on handicap games with up to 3 handicap stones. Looking at the current version of the KataGo code, nowadays it trains with handicap up to 5.

If you're 2d or so you can beat pros at 6 stones. Is katago more beatable than that? I know it's not amazing at high handicap, but I wouldn't think so.

Reply on news.ycombinator.com