Following this logic (and ignoring the increase of suffering as a raw product of addition) it's totally possible there'd be less suffering if we stayed in loosely connected hunter-gatherer societies.
Philosophers have given this a lot of thought: the "repugnant conclusion" is what to Google for.