You can reset your password with email and phone number. Did it once.
Comment 1: The problem with adding end-to-end encryption is that password reset is no longer possible (or it's possible but your data is lost)
Comment 2: You can come up with an end-to-end encryption scheme where you can reset your password and keep your data so long as you still have your phone (or when you lose your phone so long as you remember your password)
Comment 3 (mine): But if you lose your phone you often don't have your password any more, so that doesn't really help
By "Is there anything significantly different with Apple accounts?" I really meant does it often ask you to retype your password or otherwise force you to remember it.