> Prior to the rise of Rome, for example, average heights in regions that would subsequently fall under its yoke were increasing.

Agh no. Please don't use average utility (or its proxies like height or income) to evaluate societies. It matters how many people there are too! If disease wipes out half the population, and the remainder now has more to eat and grows taller, that is not a good thing.