That's why campaigning often takes on an aggressive bent, and why affirmative action is called for. Current generations steeped in sexism (I mean, much as I'm a feminist, I see many of my ingrained sexist biases) need to prop up this scaffold to make sure the changes are institutionalized and carry over and next generations are raised with less biases by means of institutions, as opposed to "just keep in mind everybody is equal, yay!"
I'm a man, and I could even agree with you that "feminism" is not a great term, but I disagree about most of the rest of your opinion. It's a serious matter, very serious, and some people do need to feel inconvenienced sometimes. For me being a feminist is nothing more than a modern open mind's rational stance. Unless you don't really care about fellow human beings.