It's the weakness of single-sign on - if the authenticator is compromised, then the attacker now has the key that controls access to all the keys.
That's the point of this solution. If we can remove the vast majority of account-compromise tactics and force attackers to achieve success only if they "get one admin," then that's an incredible victory -- especially for the large number of ordinary people who are not admins.