When the criticism boils down to "you aren't doing what we tell you to do," or "I don't approve what you do with your body," then, oh, no, when directed towards women by men this is nothing less than misogyny, and denying it doesn't cut the mustard. Leave women alone, and then we'll know you're not a misogynist. Otherwise, the descriptor fits.