Accounting for meat and dairy is probably an order of magnitude higher quality of life than I was imagining. I was thinking more a diet of beans, starchy potatoes, and mealworms for protein.
It would probably be easier in practice to involve animals and take advantage of all the land you can. Not everywhere that is currently pasture can even support agriculture that well. Maybe its too rocky to drag a plow or too steep for farm equipment. Maybe the soil and irrigation situation doesn't support much else than whatever bits of greenery are eaten by the grazers. Being able to pasture on these lands suddenly means you can actually extract usable nutrients from them.