Collectivism killed hundreds of million of people in the past century alone. This was also rationalized. Rugged individualism is much less a-social from that perspective.
So? The western states killed and enslaved just as many under various names (from christianity and manifest destiny, to democracy and free trade and "the free world").
What happened in the name of an idea doesn't mean the idea is bad or that what happened is an inevitable part of the idea.