It's often observed that as societies grow richer, their birthrate plummets. The paradox is that in order to tap into those riches people have to work more, which may be one of the explanations for why the population tends to decline in those countries.

Thus the constraint may just be "time to make babies".