Hmmm, so it seems like the signal we'd expect to see in the time series data is either (1) tiny, and completely buried in the noise, or (2) as you suggest, is large but more than completely canceled out by some other, unnamed, contemporaneous signal(s).
Either way, seems like a net win for women!