I think part of the response you're getting is that "I don't care" is still vague.

It could mean you don't find it interesting or relevant to your life. Or it could mean you don't think sexual harassment is morally wrong. Or something else.

For example, I could say that I "don't care" about cholera deaths in Africa. I think it's a tragedy and hope the situation improves, but I'm not seeking out news about it or basing life-decisions around it. I "care" but I don't really care... at least not to the point that it changes my behavior.

Then again, I'm not jumping into discussions on cholera stories to tell people how much I don't care about cholera deaths. So, it feels like you're trying to make some big statement, e.g. taking a stand against "political correctness" or claiming sexual harassment isn't morally wrong.