If you think that a very poor person can rise to a Von Neumann calibre genius, then we have no disagreement. I agree with you that having successful parents can only help the situation.
"As for your edit, extreme intelligence is not really correlated to income."
Ok, the marginal correlation breaks down at the extremes. But it's still the case that intelligence and income are correlated, so smarter kids are more likely from higher income parents.