Seems like a great opportunity to learn a bit about automating this set up. Really not hard to upload a .vim directory on a remote server for example.
But supposedly you already have an automation that you maintain your standard servers with. Adding an Ansible role that puts .vimrc into $HOME surely isn't that much of a maintenance burden?
Nobody should be ABLE to log in to servers by default, that's the way they become unicorns and not cattle.
Yeaah, that don't fly unless you're in a really seat-of-your-pants environment. =)