You want to measure the impact of educational policies on students. So you control for other factors that influence educational outcomes, and you try to eliminate those effects.
Girls do better than boys on most testing. Asians do better than other races. Free & reduced lunch kids do worse. Special education and ESL students obviously do worse. So of course you're going to adjust for these populations.
The only reason you look at the raw scores of a rural district outside Biloxi that is 70% black and compare that to the raw scores of a suburban San Francisco district that is 50% asian and 35% white is that you either don't understand math or you're more interested in making a political argument than an educational policy one.