It's worse than that.
What doctor would you go to, a white man, a black man, or a woman, if you knew that there's affirmative action for blacks/women, and you wanted (and could afford) the best doctor?
Mind you, picking white man isn't even racist, it's rational in the Bayesian framework (the white/male had to have better exam scores to be admitted to the school than blacks/women).