Here's an experiment you can try yourself if you're male: attempt to enter a typical* church or school while wearing a dress and makeup. Compare to the reactions you get entering the same establishment wearing "normal" clothes.
*I'm sure you can cherry-pick unusually liberal examples of either, but you know what I'm talking about.