Incidentally, I was in the top 10% in my last half-marathon. My next goal is to be in the top 5% (~1h30m). I expect this to take decent amount of effort and more structured training.
I recently won my age class in a 10k (6th overall out of 147 men). In a very competitive race earlier this year, the exact same time barely put me in the upper half (242/498).
While I wouldn't go so far as to say 95% sucks, there can be a world of difference between that level and the true elites.