I just gone through this process myself. You can add another 2FA method later and THEN delete your phone number. That's what I did.