Well you can, as evidenced by the attitude of the person I was responding to. That doesn't mean you should, which is I think what you really mean.

But yes, having such an imbalance in our community leads to this being a salient part of social interaction when there are much more important characteristics that should rise to the top.