Thank you everyone for your detailed answers! I have finally settled on just going for fastmail.

I'll probably try mailinabox for some other low traffic domains and see how that goes :)