I question this idea. It seems like “common wisdom” that hunter-gatherers had “nasty, brutish, and short” lives but the author of Sapiens: A Brief History Of Humankind argues that our hunter-gatherer ancestors were the “original affluent society.” They probably spent much less overall time on food than our agricultural ancestors. The H-Fs would spend 4-6 hours foraging, trapping, or hunting, and then have the rest of the day to do other stuff. They had a diverse food supply, meaning they probably got more nutrients.
Agriculturists, on the other hand, labored all day doing work that our bodies weren’t evolved for. They depended on a single crop. If anything went wrong with that crop, famine for many people was certain. And since they had less food diversity, they were comparatively malnourished.