I base it on the prevalence of stories like this, where a woman ostensibly consents to sexual advances and later regrets it and feels she had be abused.
The issue is not consent. The issue is vulnerability. Women are generally more vulnerable to advances from men and more likely to consent to an interaction when it's not in their best interest, than men would be, due to well documented physiological and psychological differences between the sexes.