24 karma · joined July 21, 2009
My favorites from my collection are a little Dietzgen No 1773, which is surprisingly featureful for something that can fit in a pocket, and a Faber-Castell Novo-Biplex 2/83N, which is kind of one of the big guns for slide rules.
Firefox 113.0.2 shows the orbits and background, but no particles as far as I can tell.
Chromium 120.0.6099.129 shows just a black screen plus the widgets, nothing else.
Both on amd64 Debian Linux.
Update: bumping FF to 121.0 did not seem to help.
* The choice of action to be returned is the one "with the highest average observed long-term reward"
* For simplicity, the payout value used in the paper is 1=win and 0=loss, which will result in the agents maximizing their wins. Presumably one could choose other payout values (i.e. points for that player in games that have that concept) to adjust the priority of the agents. The mathematics does not seem to forbid it.
* This paper uses as their first experiment a multi-player game. They state, "...for P-games UCT is modified to a negamax-style: In MIN nodes the negative of estimated action-values is used in the action selection procedures." It is straightforward and more generalizable to games with N > 2 players to simply record values from that player's standpoint in the first place, instead of manipulating it after the fact in this manner.
I hope this clarifies some things.
These diagrams were supposed to just be an update of the diagrams from the MCTS Wikipedia article, adding the correct backpropagation values, but I see there are more problems than that.