I run my own email server an never had any issues with email deliverability. There must be a reason for these bounces. Any SMTP logs?