Consider three kids -- one is rich, suburban white, IQ is 170. The other is rich, suburban white, IQ is 75. The third is poor, inner city black, IQ 170.
In this situation, which lives do you think look most similar to one another? If you answered 'obviously the white kids', then great! You get it. If you answered 'the two kids with an IQ of 170' then you need to spend some time in the real world.
Let's add kid #4 -- poor, black, inner city, IQ 75. If we want to compare across QoL, opportunity, really almost any metric, we're going to group across socio-economic lines, not IQ.
If you find yourself thinking 'Well what if that young black kid catches a lucky break and gets out of poverty' you're almost there -- the need to catch a lucky break to escape is a defining aspect of poverty and it works against even the most naturally skilled people. The amount of skill needed to overcome that lack in opportunity makes it silly to bring skill into the equation when talking about opportunity.
Really, come on. That kind of 'they can just pull themselves up by the bootstraps' is ignorant enough to sound like dog whistling.