You can always register a new passkey with the site if you want to switch authentication providers, can’t you?
Considering that today it'd add work for me today, and future work, with no additional security benefits compared to my current approach, it just don't seem worth it.