It’s better than cutting everyone off entirely, but far from ideal. You’re basically left with a half cancelled account at that point.
Edit: See @jsnell’s followup. In this response, I totally forgot that you could just change the MX records and continue to use the Google Account. I don’t know why I thought this.