SAT proposed an adversity score to address this, but it was extremely controversial and abandonded: https://www.nytimes.com/2019/08/27/us/sat-adversity-score-co...
Crime rate, Poverty rate, Housing values, Vacancy rate, Family environment, Median income, Single parent, Adversity score, Education level, ESL, High school environment, Undermatching, Curricular rigor, Free lunch rate, AP opportunity
Each school got a score.
https://www.wsj.com/articles/sat-to-give-students-adversity-...
https://www.ox.ac.uk/admissions/undergraduate/applying-to-ox...
This is one of the reasons that Oxford is beginning to seriously concern itself with background - it turns out that if you're already expecting top entry grades it's a good way of getting better students.
That, and its long-standing gross overrepresentation of children from posh schools is getting embarrassing.