Pure RL NN 'solved' simple games like Pokémon years ago. I think added challenge of seeing how well LLMs can generalize is a noble pursuit. I think games are a fun problem as well.
Look how poorly Claude 3.7 is doing on Pokemon on Twitch right now.
Look how poorly Claude 3.7 is doing on Pokemon on Twitch right now.
Please link to said project. From my search of Google filtered to 2010-2020, it returns nothing outside of proofs-of-concept (e.g. https://github.com/poke-AI/poke.AI) that do not perform any better, or instead trying to solve Pokemon battles which are an order of magnitude easier.
Playing games from pixels only is still is a pretty hard problem
Because pixels are hard.