If you take a constant fertility rate of 1, you'll always have an inverted pyramid, until there's no more pyramid.

(I'm assuming that the life expectancy does not change significantly)