A REPL like bash already is not a pure text stream, since readline is used. Zsh, even less so.
But I agree that having multiple windows, etc is a whole new step; it's just a limited GUI accessible easily via SSH. Could involve sixel graphics as well.