>whole screen updates directly over the wire

Not whole screen. Whole windows.

You can use VNC, but it won't integrate well with other windows.