Everything is already lost if your email is compromised as they can just use the "forgotten password" functionality and reset it thanks to their access to your email.