If your phone just holds a private/public key and your access method relies on an admin portal allowing access to nominated keys (think github) - then you could revoke access to a stolen/lost phone and add access to a new device.

The device could be a phone, it could also be a smart watch. It could be a "smart" fob designed for key exchange. It could be a smart fob surgically embedded offering key exchange.

cheap backup phone?