Want to learn math but come from a poor neighborhood? Good luck. You’re probably locked in a school system with bad teachers and few if any math courses beyond calculus.I've read and listened to a number of accounts about how peers in poor neighborhoods are the biggest barrier to academic achievement.
Even if you’re talented you probably know 0 people that can help you. Now your growth is prematurely stunted.
Or worse, your peers punish you for your ability. In my personal experience, they can even tell you that you are sexually inadequate and somehow less essentially human. This feedback is all the worse, because it is genuinely believed by the one giving it.
That kid from a better off family that shows talent in math? Probably get recognized for it from an early age and gets tutors and advanced training. Probably already completed proof based courses in analysis, algebra by the time they completed high school. They get into better schools and have ahead start. Even if they are just as talented as you the poor kid.
There are cultural contexts where children form groups and help each other and offer moral support. Such social interaction seems to be attached to high performance in just about every human endeavor where skill and knowledge are important. One study found that Asian kids were very good at forming such peer groups to study math, and that African American children were much more prone to studying alone. Asian cultures are noteworthy, in that academic achievement is prized even by the poorer segments of society, though I've also known African Americans who are from families with such a subculture which prizes knowledge and academic achievement.