I think you are looking at the wrong metric here.
It’s not about “how many successful people out there didn’t go to the Ivy League”, it’s about “how likely is it that _my kid_ will be successful?”. And the Ivy League really has a major impact on the latter metric. (I mean successful in the classic boring way here - completely agree that this is a very debatable goal, but that’s not my point)