I guess my question is: why is this tolerated? Isn't it just simple harassment so management have to actually do something (even if they don't want to?)
That said you are right; you should also raise the issue to upper management. You have more options than just speaking to them directly.