Agriculture made humanity a lot more resilient to changes in food supply. Maybe this has negative consequences at the individual level but as a species level it's pretty clear which one is more favorable.
Sounds like it would be a trade-off then, not a clear favorite, depending on what you're optimizing for. Especially when we can afford to focus on maintaining health at an individual level too.
https://www.discovermagazine.com/planet-earth/the-worst-mist...