Is that what you're panicking about? This means that for the next 50 years, we'll continue growing. Lack of offspring of current generations is clearly not the problem here.
I still remember how in the 1980s, people were panicking that the world population kept growing, and sooner or later we were going to hit 10 billion. And now 10 billion is not enough?
It's obvious that this population growth is not sustainable. Sure, the Earth may technically be able to feed 40 billion people if we all turn vegan, but so far, we don't exactly have a good track record of dividing our resources equally. That is a far bigger issue to worry about.
Should the population grow or shrink? I don't know, but whichever we end up doing, we should do so sustainably; make sure every kid is fed, cared for, received the best possible education, and can live a happy life. And if young people don't have the time or money for any of that, not having children is the responsible choice for them. If we don't like the results, we should change our economic balance to the point that they do have the time and money to raise children.