Use a local vim, and use its ssh support. It will download the file to the local buffer then upload it when you save. This way your vim config remains on your local machine, too.
Related, netrw (vim) can do quite a lot of things that I think people don't realize. I mean not just that it supports file trees, but well... just open :h netrw