I just find it insane that we're bootstrapping reinforcement learning and world planning on top of basic next token prediction.
I'm amazed that it works, but also amazed that this is the approach being prioritized.
I'm amazed that it works, but also amazed that this is the approach being prioritized.
Look how poorly Claude 3.7 is doing on Pokemon on Twitch right now.
Please link to said project. From my search of Google filtered to 2010-2020, it returns nothing outside of proofs-of-concept (e.g. https://github.com/poke-AI/poke.AI) that do not perform any better, or instead trying to solve Pokemon battles which are an order of magnitude easier.
Playing games from pixels only is still is a pretty hard problem
Because pixels are hard.