"Moreover, I don’t think many people have even thought of slavery when referring to “master” in CS context before it was brought up in this manner."

That's probably true, and it's probably people who didn't have grandparents that were slaves. It's closer in mind to some more than others. And if we want to have CS be more open to the black community, then being sensitive to how words can turn people off is important.