I'm sure some people in the cities died if they couldn't find a better situation for themselves, but what I had read was that many abandoned the cities because life there had become unbearable for whatever reason, generally caused by severe mismanagement by the society's rulers.
If people are leaving academic professions to work as stockers at retail stores, this does not bode well for American society long-term. You can't have an advanced economy and society without an academic class.