I use Vundle to take this a step further

https://github.com/gmarik/vundle

Why git? I store my .vim directory in dropbox and just have it symlinked into my home directory on each of my machines. I don't really see a need for version control, and I don't want to have to do anything to make sure a change on one machine is reflected on all the others.

Why can't you also keep your .vim in git too then? It seems to work well for me. see: https://github.com/kristopolous/vimbuild