Also, even if you both run your own MTAs STARTTLS does not help much except to reduce the scope of the passive-only surveillance dragnet, because the configuration does not require signed certificates.
Finally, if both parties are technical enough to run their own email servers, um, why not just use GPG?
From a technical point of view, I put this squarely in "fun, but a boondoggle" territory.