It’s not different from just a password. That’s why no service uses an unrecoverable password as the only authentication mechanism because it would be a terrible usability and security problem.

Ordinary people expect to be able to reset forgotten passwords. And because people are bad at managing passwords, reasonable services try to get them to use 2FA so their accounts wouldn’t get stolen. A service that uses plain private keys has both problems.