Disregarding the general reality that socioeconomics broadly has an impact on academic performance as a result of the resources people have throughout their development, there are only so many scholarships an Ivy League school will offer. So regardless of your hard work you are potentially or primarily limited by your ability to pay to begin with.
Being able to afford an Ivy League education is a position of privilege. Both for tuition and also everything else someone needs to live.