The password is the recovery flow. What do you propose instead that isnt just a variation of having a password and a passkey?
double triple emphasis on "memorized"
place it in a fireproof safe alongside your other important documents, like your passport and birth certificate.