I personally would use it on top of something reliable like Fastmail. I mainly use Gmail over IMAP and it's painful slow and glitchy.
If what you're building could give me a great UI on top of Fastmail for when I want to use the web, and access to some kind of self-hosted archive, I'd probably go for it.