Before global media, for the most part if you were comparing yourself to other people it was largely comparing against your friends, family and community. Sure, there may have been that one outsized success, but it still wasn't presented as the norm - you knew all the other friends and family that just had average lives. And for most of human history where social ranking was explicitly classed based, it's not like if you were a peasant you would think "Darn, if I only worked harder I could be a noble".
If you want to feel "less hard on yourself", I highly recommend disconnecting from digital media. It's hard for our human brains to deal with the constant onslaught of stars/celebrities/moguls/exceptions and understand how rare those examples truly are.