To some people, that means "one who removes copy protections from software"

In fact, they mean "hacker," because you don't get to define the words they use.

But if you said that, people would think you're making an epithet against white people.

You are totally correct!