When someone actually says they “worked hard” it’s usually bullshit, because people who actually work hard either don’t realize it or are too humble to admit it. So saying you worked hard is a justification for why you have something or why you have something and someone else doesn’t.
Most people who make a lot of money don’t actually work very hard by virtue of the fact that most individual wealth comes from capital, not labor. Maybe you did work hard at some point to get that capital, but that’s also unlikely. After all, if capital paid out the true value then it wouldn’t exist at all. So somewhere you either exploited people or natural resources to get that capital.
Hard work sucks. It almost by definition doesn’t pay well, with few exceptions.
But we need to justify to ourselves and others why we value different humans different, and hard work sounds really good. So we invoke it to justify to ourselves, mostly, why we are superior to others.