This is what I do. I can clone a git repo, run an install script, and have my typical vim setup running in a trivial amount of time.
cd
hg clone http://bitbucket.org/sjl/dotfiles .dotfiles
ln -s `pwd`/.dotfiles/vim/.vimrc ~/.vimrc
cd -
My full Vim config is now installed, plugins included thanks to Mercurial's subrepos.But really, I don't find myself editing files directly on servers all that often. And when I do I usually prefer bcvi anyway, because I can use MacVim instead of Vim through a terminal (which I hate because of all the shadowed keys).