I've moved to Fastmail in 2015 and I had a long term Gmail account since high school, I've never missed Gmail one bit, I encourage you to do it.
Moving to fastmail would be a possibility but they do not have a calendaring system.
I see a FastMail app on the App Store but from the screenshots it looks pretty bad (is it just a web view?)