I would absolutely do labor, if it paid the same, as long as it wasn't the most basic (e.g., digging ditches) labor.
I worked at a car wash (vacuuming, drying cars, etc.) for 9 months when I was 15, and I loved every minute of it, despite the fact that it was very laborious. I had many jobs in the year before that, most of which were inside without much labor, and I hated each of them.
Then, I framed houses (first 3 months were basically just carrying things around and making cuts for others) for a year when I was 16, and it was a blast, as long as it was warm outside. However, what was not a blast was making $7.25/hr. I felt great though, super healthy from all the lifting, walking, climbing, etc. The only non-monetary negative was cold weather; swinging a hammer in the cold is no bueno for anyone.
I also did landscaping at 17... for one day. I'm not going to lie. Landscaping is mega hard work, and the 3 Mexican men I worked with put me to shame in less than 6 hours, despite my frequent visits to the gym and +10 years of youth I had on them.
Now, I write code. I love it, but I absolutely hate being in a chair, and standing while I type is not appealing to me. I work out for 45 min every day at the gym after, but it doesn't make up for all the cave-dwelling I do.
In summary, I think that labor is usually really rewarding, even when you feel pooped at the end of the day, but certain labor jobs push the envelope a bit too far to be called "rewarding".