where is the server hosted? In your home or hosting provider or cloud? Keeping a server running 24x7 is the challenge for me as far as email is concern. What happens when your server is down and someone mails you?
I imagine that if the client or an MTA can't connect to an SMTP server, then the mail would stay in an outbox queue until it is able to connect and hand it off. I don't think mail is permanently lost if an SMTP server goes down for a few hours. If an intermediary MTA gives up on connecting to an SMTP server, I would at least expect it to bounce the email back to the sender with an explanation.
I don't think email is as fragile as you seem to think.
And if deliver fails, the sender also gets an email (from their own MTA) mentioning that delivery failed.
Its a email server I am writing myself to eventually use. I know mail-in-a-box exists but another solution providing a easy to setup reliable mail box should be useful.
Currently I have spf/dkim/dmarc setup so it can exchange with all providers and have imap for the client side.
Do you plan to open-source it? I have to agree that last time I looked into setting up my own email server, the setup procedure of pre-existing servers is what drove me away.