This is usually related to the kind of job you are doing.
My mother was cleaning schools and that is a killer for the back. Being retired, she takes long walks and keeps herself active and healthy.
But when I was studying I saw quite old teachers still active, and happy. But that's a different kind of job with different effects on your health.
> I think part of the point is to find a [a]vocation that is not stressful, you enjoy, and can do a long time.
I agree. If you are lucky enough to get a job that fulfills you, then continuing working can be a good thing. That's why we can't just delay retirement age, but we need to take into account personal circumstances.
A not stressful and enjoyable work also helps you to keep your good health for longer, so you get in better shape to old age.