This makes sense as we probably subconsciously dislike the idea that our perceptions are belittled by people who we imagine as beautiful and successful. We value those traits and when we're told they're not valuable we understand the person isn't being genuine.