So as modernity attacks the desire to reproduce (with abortion/birth control, modernity, education, distraction, late marriage, etc.) we end up eliminating people who are vulnerable to not reproducing. The only people left will be ones who are resistant.
So my overall point is, even though the population growth rate may be slowing down, it doesn't mean it'll slow down forever. There are already resistant strains at low frequency in the population now - they will increase in prevalence and become the majority; they'll continuously suffer defections, some of whom will be high achievers due to not spending the time to reproduce, and the mindset that allows them to break away from conventionality - but as long as they don't reproduce, they'll be gone eventually.