Not "despite", but "because".
In an agricultural society, you need lots of children because you need a lot of hands working the farm. If you're dirt-poor in an industrial society, you need lots of children so they can all work in factories to earn money for the family. In any society with a high infant mortality rate, you need to have even more children because you can expect a lot of them to die young.
In the modern West, we're not subsistence farmers or dirt-poor factory workers, and almost all of our kids survive to adulthood. We don't have lots of children because we don't need to have lots of children.