Human brains are Bayesian filters. Affirmative action policies will understandably influence the prior even among individuals who believe in diversity and inclusion.
When she "starts talking," a fair-minded individual will develop a posterior that appropriately updates any suspicions that were previously held.
And while there are some who are fair-minded, many are not. So such a person is in a lose-lose situation. Those with bias will discriminate against them -- and "fair minded individuals" will use take their poor relative performance to inform their prior. Try to compensate for that, and those fair minded individuals use that, too, against them.
So "fair-mindedness" leads us to perpetuate discrimination. Which doesn't seem very fair.