This slowness could also be due to keeping a swap/backup file. Maybe try switching that off.

For that poster above, I've never understood the appeal of gvim or macvim, I am very happy with vim in a console (with tmux.) Perhaps there are some plugins that work better under (mac|g)vim.