This sensitivity is probably due to the fact that, as a culture, women to do a bit more of the child-rearing, and they want things to be easy for their sons. Women see themselves in their daughters and daughter-in-laws, and are harder on them for it.
If a married man is dressed poorly, it's his wife's fault. If a married woman is dressed poorly, who in their right mind would blame her husband?
It's crazy the expectations we put on men and women and how differently-loaded they are...we as a society typically have such low expectations of men, some people don't think men can handle a 9-5 job AND a single load of laundry or changing a diaper, which is totally insulting. We say it's too hard for them to do both...and then we put them in charge of everything.
It's no wonder we're in the messes we're in.