I feel you, but as someone who's in the earlier part of my career, it's honestly not that bad once you learn more about the contours of how it works. There are plenty of people like us who weren't stupid enough to buy into "ignore your capacity for rational thought, believe this by fiat"; they just know not to talk about it in case the person they're talking with is one of the dumb ones.
If anything, IME watching people fall into this trap is a pretty reliably useful indicator of someone's intelligence. I tried it the last few days with a handful of people with whom I'd never discussed politics: "Did you hear about that Google manifesto thing?". I tried it with 8 different people both at and outside of work, and every single time, the people who were uncritically outraged were the ones who I already knew were pretty stupid. Not a single person that I already knew was intelligent had this kind of wild-eyed negative reaction to a guy saying "maybe we shouldn't assume that differences in the employee population aren't due to differences in the input population".
FWIW, my personal best guess is that what biological differences there may be between men and women aren't sufficient to explain the tech gender gap. I just think that it's fucking insane to pretend that the science has conclusively shown that there are no such differences and to attack a guy who dares mention them. The notion that scientists can talk freely about something but laymen can't scares the shit out of me.