I actually come from one of those so-called Great Families. Three generations back, there were 3 siblings who all had national or smaller success in creative, financial, and mathematical fields, including one who won a nobel prize. Many of their descendants also had successes, although of a more modest variety.
However, in my generation, there were lots of money problems. And they did what money problems tend to do -- delay, deny, disappoint, cause health problems, and make everything harder.
The "brains," such as they were, were still there. If we take the usual markers* of intelligence there were Ivy League admissions, Fulbright scholarships, and so on. But for me at least, not having affordable healthcare at age 20 impacted my life much more in a negative way than getting a 5 on the Calculus AP impacted it in a positive way.
I'm much less interested in the concept of inherited genius than I am in universal health insurance and free college.
*Which are themselves problematic, and often merely markers of class, but it's the best I can do here for a HN comment