I volunteer over the weekends to build Habitat for Humanity homes. Yeah, I could probably make money if I freelanced on the weekends, writing code, but honestly I need time away from the computer, and working with my hands to build something tangible feels good.
In reality, I think that we do good things as much to make ourselves feel better as to make the world a better place. So with that in mind, do what makes you feel best about yourself.