I was thinking Password manager + TOTP or yubikey.

Of course it does also have downsides. I don’t store all my passwords there.