There are only a few outliers, by definition. So most people have to make the compromise. Coordination games work by punishing you when you don't follow the crowd.