Do you have a source for this claim? Specifically that women aren't having less sex too, and that the decline is almost entirely due to men. It's very possible for women to be more selective than in the past, and also everyone being less promiscuous overall.