Depends on the nature of activity. Pure stress will activate your brain but experience is mostly degraded.
So stressful environment would speed up the evolutionary iteration of generations. While less stressful existance that has adopted to the environment would persist longer.
It's also possible the association is in the other direction - people with neurons that fire less might be less stressed in general (almost by definition), and maybe the effect of stress on longevity takes place elsewhere entirely.