Might be your term if its slow vim will be slower... For example Osx terminal.app is slow...
For that poster above, I've never understood the appeal of gvim or macvim, I am very happy with vim in a console (with tmux.) Perhaps there are some plugins that work better under (mac|g)vim.