Ask an anthropologist if this is true.
You’re effectively just saying that whatever the status quo is right now, that’s what we naturally gravitate towards.
I think that we would get back to “organized society”, yes. But for different reasons. (Basically: more population density leads to agriculture which leads to food stores which leads to a ruling class that can hoard the food stores which leads to things that can be raided (what’s there to be steal from hunter-gatherers except for slaves?) which leads to competition, and so on.)