To your point, I believe AlphaStar had access to both the visual input and an API for most actions in the game.