As a matter of principle I don't think we should be moving towards ignoring any and all contexts of words. Granting this power of word banning to random arbiters is quite crazy. In this case, master was moreso changed because it -could- be deemed offensive, not that it -actually- is offensive by itself. Not one person that I've spoken to about it has actually cared.
Words having multiple usages is not really a novel concept. If we ban words based on them potentially being offensive, we'll end up with no words at all as people move onto using different words, and so forth.
It is not silly to have pushback when someone wants to grant themselves power over language usage. Dropping usage of a word should have a strong, tenable argument and larger community support than 0.00000001% of people caring.