If you use Google Apps with your own domain and make backups of your mail, then you have a very small chance of losing your address and your mail.

People hate on Google Apps, but you don't give up control if you follow both these steps (which is easy.)

I also don't see any reason why another email provider won't do what people are afraid Google will do.