> it isn't in the direction that you think its in

It is exactly in that direction; just look at the outcomes. You take the long-term standard, where white (and Asian) males get advantages, and normalize it - norms are unremarkable, the null hypothesis. Changing the norm then looks like discrimination.