In the book society was already collapsing. Plenty of regular people in the novel realized something was wrong and removed themselves from the looters' economy to roam the country.
Galt simply refused to be the one to prop up the looters failing economy.
Interesting that you see Galt as the one collapsing society. Rand's point was that the looters collapsed society and that they were too ignorant to understand why or how.