Vision especially GUIs are a pretty limited API.
https://prirai.github.io/books/unix-koans/#master-foo-discou...
Imagine OpenAI can not only read the inflection in your voice, but also nuances in your facial expressions and how you're using your hands to understand your state of mind.
And instead of merely responding as an audio stream, a real-time avatar.
or maybe my own HAL9000..
A little bit ambivalent on this haha, looking forward to seeing what comes of it either way though :)