It’s not obvious to me. If they are so successful at exporting food, I’d have thought they should do more, not less.
Anyway, where does this "people don't need X" stop, though? You also don't need oat milk, tofu, soy, peas, etc. to survive.
Let's just go back to foraging for roots and berries and see what population size we can sustain!