I think everyone has challenges at work.
Sexism works both ways, women can be sexist about men too.
I've been called homophobic slurs by women at work because I don't like sports or going out and getting drunk, etc.
Not much you can do about it when a manager does it, and enforces your coworkers to do it too.