There's several people here commenting that physical work can be refreshing and rewarding compared to office jobs, but often that's only in a part-time or volunteer capacity. I can attest to it being a nice change, but only ever as a part-time project. I would guess anything you do full time long-term will some time or another feel a bit of a grind. Manual work in particular can take a serious physical toll over the years, and being mostly sat down indoors for your job can end up being tempting too. I also know a couple of musicians who are perpetually on the road, and it's not always a glamorous globetrotting lifestyle - one said they mostly see highways and airports. But then there are great gigs too.
I think there's probably no such thing as a perfect job. That's not to say a change can't be refreshing or worthwhile though! Perhaps it's just that after many years most people eventually get a bit tired of whatever they're doing, and then the grass can look greener on the other side.