Let me be very clear. When I was 15 I took the SAT and got every single question right. That was undoubtedly in part because a) I grew up in one of the wealthiest counties in the country b) my parents got me private math tutoring from the time I was 7 c) they read to me from an early age d) they sent me to private school e) I could go on, but you get the point. If you do well on these tests, good for you! But the idea that they are unaffected by confounding factors like income, education, and stereotype threat is absurd. These false beliefs that we can just give people a test to measure true talent worry me in light of Silicon Valley's incredible lack of diversity.
If IQ tests worked as you described, then in studies of twins going adopted into different households, we should see life outcomes correlated more with foster family than with each other. It turns out that twin life outcomes are very closely correlated with each other and strongly with IQ tests than they are to rearing family.
Your beliefs are the ones that are false, sorry.