If there was decent workplace safety (my hometown is infamous for it's poor safety standards), and a good pension program where you're expected to want to quit and do something else after 10 years or so, before your body is ruined, then I'd be all about it.
You won't lose fingers or lose your hearing if you take proper care. You won't destroy your back if you stay in shape. There are pressures to do the wrong thing. People can resist them. There are risks; this is why people wear hardhats and steel-toed boots on worksites. But the risks can be managed.
The pay remains .. a challenge.
A good parallel is motorcycles. A good motorcycle rider is much less likely to experience accidents than a bad rider, but even the best rider is still more likely to experience accidents than a car driver, simply because of all the other people on the road. You only have so much control. Likewise, even the best construction worker is still more likely to wear out their body or experience accidents than the average office worker.