With being unattractive, there is a metaphorical "gut punch" of sorts that you always get when meeting people. Often even from people you know. Imagine just before going on stage to give a presentation, getting yourself psyched up, and someone tells you "Your voice sounds kind of weird". It just entirely kicks you off kilter and it comes through in your talk. Being unattractive you end up getting kicked off kilter a lot. You might not even know it if its all you have ever known.
But when you are good looking? It's almost like it switches and people make themselves vulnerable to see how you evaluate them. It's your word and your actions that matter, not theirs. People just openly pour confidence into your cup.
The whole things is so bizarre logically thinking, it's so primal, so human.