It's true that most people aren't like me in many ways. But that's not what's meant by "outliers". To have an outlier, you have to have some way in which most people are alike.

Eg, most people don't have $1 million in the bank. If all the financial advice you can read on the internet were written by millionaires, it might (eg) encourage risk-taking that isn't wise for average people. But you could get the impression that such behavior is normal and expected, since "everybody" says they do that.