You are not subsidizing their ability to receive mail from you. You are paying for your ability to send mail to them. It's the same rationale as the universal service fund for phones. A network like the phone or mail network reaches it's full potential only when it connects everybody.