If you live too long you take resources away from your offspring.
(If this weren't the case, you would think that evolution would drive us to die shortly after we had children, or at least after we lost our ability to have children.)
Is this effect significant or not? I don't think we can guess at these types of things. Subtle changes in a complex system are hard to predict.