I don’t think the point is that physical work makes humans intelligent in comparison to animals. I think the point is that physically active humans exercise aspects of their intelligence that modern sedentary humans do not.