More so because there is no proof for that.
Individuals exhibit different levels of intelligence. Sure, life is unfair.
However, individuals do not necessarily inherit intelligence from their parents' genes. Seriously, who could think that you could build a lineage of "gifted persons" solely by genetically selecting the parents among the population of "gifted persons"?
What we observe could be explained by many other more convincing factors: early learning activity, more care to the child's education, logical and clear answers to the kid's questions about the world around him, help with the homework, etc. With proper early learning activity for the baby, and amazing teachers for the early teachings, the kid has a strong foundation. From there, compound returns.