It's not. We need a sustainable size of population. Unlimited population growth is not sustainable. It doesn't mean that we are going to die out. It just means that there are as many newborns as old people dying. Check out this good old Hans Rosling video:
https://www.youtube.com/watch?v=ezVk1ahRF78