Without peaceful growth, eventually there will be military growth [expansion by the means of military violence].
Op is right that our Earth is limited and cannot grow indefinitely. Sometimes it will be followed by redistribution of growth, so that someone will continue to grow, while others will experience radical negative growth