That being said, you can't have a strict equality of opportunity without acknowledging which people didn't have that opportunity. I think it's much easier to fix this problem if you focus on the person (e.g. Sandra couldn't afford college) rather than the group (Sandra's black and statistically less likely to have been able to afford college).
The problem is people use these bullshit heuristics that happen to suit their mental model of how they want their neighborhood/workplace/world to look ("We don't have a black woman in accounting, what's wrong with that hiring manager?" or "Everyone on the database team is Indian why can't they hire a white guy?") rather than just trying to be fair while still acknowledging systemic issues people have had because of the groups they may belong to.