I moved my e-mail off Google a few years ago after the PRISM leaks (which the world seems to have collectively forgotten about), but it's not easy. I've posted an article before on my struggles with running my own e-mail server and my messages going straight to spam (even with valid DMARC, DKIM and SPF records).
I have a lot of friends internationally and I feel I can't exit FB, Google Hangouts, etc. The idea of federated social networking never really made it. :(