EDIT: not calling anyone a liar.
First, that's lacking in civility, you've been here long enough to know that tone isn't appropriate.
Now then. The fact that your experience is not statistically significant isn't a possible counter argument? In order for you to be right, you would need evidence not only that most female mathematicians were harassed, but that they left the field because of if. If you have exit interview data for a random sample of former mathematicians, there are a lot of people here who would probably love to talk to you.
This is an especially unfortunate stance given that this is an article about math.
Edit: I make no claims one way or the other, I'm only talking about statistical validity.
Men in specific industries have a higher likelihood to sexually assault women, so much so that it pushes 90% of the women out of an industry with greater than 10M people. Do you understand how delusional that is?
Just because your coworkers aren't literally raping you doesn't mean that there aren't men out there who will be huge assholes to women.