> when you lose it though you can verify by calling up and giving personal information to verify it is you

That is no longer secure, and cannot be made secure where voice calls are involved. Any entity trying to authenticate someone's humanity or identity over the phone will be cutting off that service, post-haste.