I'm currently wanting to study bandit methods and tabular reinforcent learning. These are limited, but simple and predictable, which is important for games.
I'm currently wanting to study bandit methods and tabular reinforcent learning. These are limited, but simple and predictable, which is important for games.
Even for a seemingly "simple" game like Bomberman, tabular reinforcent learning isn't going to work. I tried it with a huge table with 1000+ states and 1mio+ transitions but it still couldn't capture the complexity of that game. Plus you can mathematically show that the value estimates aren't going to converge, due to exploding variance.
In short, I believe you'll need serious research to go from the current "state of the art" in RL AI to something that is remotely tolerable in a AAA video game. But that sounds like a interesting idea, so maybe you should get your feet wet by building a small RL AI for Bomberman yourself, so that you know how things work. I have replays and instructions for that in the discord too, search keywords "gocoder-bomberland-dataset" and "behavioral cloning".
A long time ago I had the idea for a Swords and Sandals type game (a gladiator game) where each opponent was actually a simulated neural network and you could peak under the hood much like this.[0] Each gladiator would be simulated against each other and would actually be learning as they played against each other. Difficulty for the player wouldn't be based on any setting, but rather just having to face the AI that's learned the most and gotten the best
Anyways, since then I've figured it doesn't really have to be a gladiator game. It could be tic tac toe or connect4 or chess or whatever else
The library is fully documented, but the text is probably a bit dry. I'd love for somebody to help me improve its accessibility, and I'd be willing to help them along learning how things work.
My email is my nickname and Gmail, feel free to reach out if you are interested.