Reminds me of the cave X11 games. For game play I'd suggest slowing it way down.
I'm always biased since I test locally with no delay when developing :)
I'm thinking about simple ML to predict inputs and feedbacks. Since the amount of data generated in the streaming is massive and well structured, it looks like a possible approach