Not sure "original concept" is quite right, given it had been tried earlier, e.g. here's a 2023 attempt to get gpt-4-vision to play pokemon, (it didn't really work, but it's clearly "the concept")
[1] https://community.aws/content/2gbBSofaMK7IDUev2wcUbqQXTK6/ca...