Yes, but not for long. Migrating to a self-hosted mail server is one of my top priorities [1] for 2013.
[1] - http://www.slate.com/blogs/future_tense/2013/03/26/andrew_we...
[1] - http://www.slate.com/blogs/future_tense/2013/03/26/andrew_we...
Here is one with virtual domains, etc. might be overkill for your usecase though.
http://workaround.org/ispmail/squeeze
I personally run a stack over courier and some other hacks ontop of rdeliver, which works really nicely.
Important: Please always make sure to check that you don't run an open relay.
Other than that, there's the thing that I need to trust my VM provider, but that much easier than trusting a data mining conglomerate with your private conversations.
In the end, self hosting an email server isn't that big of a deal to set up and maintain.
I've even seen Gmail mark its own address confirmation mails as spam, along with many mails from people I frequently converse with.