same here, and tmux lets you share more than just your vim session. We use it regularly for pair programming, some times even in the same office, each one at his own computer.

I liked that coVim launches its own server, so you don't rely on having to ssh to the same box, but at the same time, I imagine ssh should be safer.