100,000 supposes that there are... hmm... about eighty thousand non-evil people in the world, and (odds are) exactly none of them are Marshallese and about 2 are Samoan, to give a sense of how silly this is.
You also appear to be assuming there are no mid range people who everyone ignores, that is going to be the majority of the population.
Society holds well if someone steals a candy from the shop.
Those people can become shitty and despicable for that one person they envy and can be great for their friends and family all the other time.
There are really evil people that might be shit all the time but society is rather good at spotting them.
I think maybe 1 in 100k is actually anything special, but odds are you aren't special, you just noticed that 20% of the population is as gifted/motivated/constructive as you are (statistically speaking, assuming a bell curve).
And of those, yes, some small percentage will still feel "special" and affronted that other people have the same ideas/goals/desires as them.
It's a rat race and it's not your fault.