If you were an under-nourished worker, living in the rat-like polluted conditions of an Industrial Revolution town in Northern England (for instance), constantly breathing sulfurous fumes, suffering cholera epidemics, seeing the whole town and all the countryside around it blackened by the ash from the local factories, while still seeing children die prematurely from all the same diseases and accidents that were common in the Middle Ages, but with less access to fresh air and your own vegetables and (to some extent) your own livestock, then making the life of a peasant seem less attractive than it maybe was in reality, is not such a far-fetched possibility.
> watching too many of your children die before their 4th birthday
As for children dying - maybe the children of peasants would die in greater numbers than the aristocracy, but nothing stopped their children from dying of an infected scratch or a bacterial infection, any more than anyone else, before the invention of antibiotics.
I think your comment falls into the “it was unadulterated hell being a peasant”-trap that I was referring to, instead of evaluating whether the life was actually more nuanced (especially in relative terms to those richer than themselves at the time).