No, not true. Many societies in the world have voluntarily reduced reproduction to the point where population growth would be zero, except for improvements in longevity.
These changes largely pre-date small recent drops in living standards, having taken place at the end of unprecedented runs of improvements in health and quality of life.