My experience has been likewise.

Only problem I had, and still have in the short term, is that one server's IP C block has been flagged by one spam service. And even though my server's IP gets a clean bill of health from all other SPAM services, outlook.com refuses to accept mail from that server. I had them white list the IP but it reverted shortly after that.

The ISP (strato) refuses to do anything about it, and not sure if there is anything they can do, so all I can do is vote with my feet.

Otherwise, running a personal mail server is hardly any effort at all. Use Webmin for admin.