Ah, magic dirt. It's all to do with the patch of land you hail from, and most definitely doesn't have anything to do with who your parents are, their IQ, or their genetic legacy...
By the way, how well do your theories on IQ and "genetic legacy" (nice dog-whistle) perform in combination with the actual data that shows pretty much every country in the world improving under almost every metric? Take Bangladesh now vs. 50 years ago for instance. Did the nation's "genetic legacy" magically improve over that time period?
Though I guess it must be easier to just attribute your situation to genetic superiority, rather than to theories supported by actual data.
However, if you tell me that somebody's parents average an 85 IQ or have family histories of dyslexia, short-term memory deficits, schizophrenia or bipolar disorder, that's more predictive of how well they are going to do in life than what zip code they happen to reside in.
No one believes in "magic dirt".
When we see such a strong correlation, it leads us to ask questions as a society and sometimes, those point to some uncomfortable truths.
Your parents being in a poorer part of town is often because they do not have the means to live in the richer parts with better schools, more socioeconomically accomplished neighbors. Genetic legacy could be a factor but I implore you to do a bit more research on the history of IQ tests as they are today and understand that it is often hard for a measure developed by a benchmarking a non-representstive sample of society is very unlikely to represent the whole. (Check out Radiolab's recent series on Intelligence for example).
I'm not sure the kind of life you've experienced but there are several people smarter than you and more capable in many ways who will never get the chance because they never had the access.