Yes, but then this takes away the idea of one private key to rule them all for identifying someone. The moment you've lost that key, you've lost access to all the services relying on it. Each might have their own backup mechanism to fall back on, but suddenly the UX really sucks.