Sounds like you're on the right track. I think the philosophy that will get you there is "Solve Everything Twice". I've done that from day one with my revenue generating products, and I can go weeks at a time without even needing to answer customer support mail these days.
The idea is that if anything ever goes wrong, you fix it immediately. But then you figure out what you can change in the software so that that particular thing (or class of things) never happens again.
This isn't just for software errors. It works for customer support as well. If you keep getting mail asking the same question, it's a sign that something's not clear enough in your onboarding or documentation. If people keep asking for an account tweak, you need to either make that into something they can do themselves or, if they already can, do a better job of surfacing the feature so that the next guy will find it.
Over time, your inbox will shift away from panicked customers in need of an immediate response, and towards "thank you" type mails and feature requests, with the occasional oddball request that actually takes a bit of your time.
Sprinkle all the above with a bit of "setting customer expectations" so that your users know ahead of time that two days is a reasonable amount of time to wait for a response for an email.
That won't necessarily get you decades off, but it will let you crew a sailboat across the Atlantic with a reasonable expectation that your business will still exist when you pop back onto the grid a month later.