Back when I was hosting my emails myself, my main complaint was that it required plugging many pieces together, in a traditional Unix fashion. This was before configuration management was really a thing, so it resulted in a Frankenstein setup that worked but was afraid to touch.
If there was a more modern all-in-one-binary solution handling MTA/DKIM/IMAP/webmail with sane defaults I would maybe go back to self hosting.