Part of it may be matching to the use case.

Men will buy a shirt and wear it until its seams break in 2-10 years.

Women will buy blouses or dresses with cuts/colors that only work in certain seasons to be worn for a specific occasion that won’t come to pass again soon.

Now where women have more trouble is just in the utility work wear shopping space because that clothing is utilized frequently and until it fails.