What if the email account has been compromised? Right now, having unique passwords for each account allows me to compartmentalize access to my accounts. In this case, the attackers would have one less thing to worry about.
Also, is this behavior carried over to the mobile apps?
edit: Nevermind. I was not thinking right. Password resets, as pointed out by many, are always possible with email access.