The question is why “people of color” isn’t an equally harmful relic, which the article doesn’t really seem to explain.
Scott Alexander's hypothesis explains all of that. Constant change is what makes fashion fashion, and fashion is a very effective way to discriminate between the in-group and the out-group.