It might be hard for men to ignore any sexual aspect in interaction, which in many situations (like pitching at funding events) is definitely inappropriate and unpleasant; you are right to call that out. I'm not excusing bad behaviour. But for better or worse, no matter how unfair it might feel or how much insult it adds to injury, you've gotten an answer.
I would find it hard to believe someone goes to a fundraiser to ignore a genuinely great idea/product just because they feel a bit horny. I doubt you'd want a person with such lack of focus involved with your company.