Here's my over engineered setup: https://github.com/jakeogh/gpgmda It attempts to also store the metadata encrypted. Admittedly got a bit carried away trying to hide mtimes.

Just use a procmail rule to call gpg on every incoming email before it's stored using your public key, then your client (configured with your private key) can decrypt every email as normal.