> every time a rich man takes an extra wife, another poor man must remain single

Or he could simply be already dead from all the warfare. These two things connect in positive feedback loop: men dying in war create gender misbalance that would push more women to become second and third wives as well.