I've pretty much come to realize this as well, which is why I think at this point people should stop having children and we can just wind things down in an orderly fashion.
If anything, we are not creating enough people. There are both implicit and explicit growth obligations underlying the functioning of society, a population collapse would almost certainly result in extreme destabilisation.