I’m surprised you find ssh+vi having medium typing latency. I have ssh’ed to either my desktop to (later) my cloudtop and latency has always been great. The ssh latency is good enough that I can run X forwarding to launch graphical instances of emacs and gvim. The latency was basically unnoticeable.
Later I rented a vacation home in South Lake Tahoe and worked remotely. It was only then that I realized it had terrible latency.