As a google apps admin for my work I backup the entire domain's emails - there are a bunch of companies offering this as a service these days.

As a personal google mail user I use offlineimap to synchronise with a local maildir for both redundancy and reading my emails.