Well, I agree, and I take that idea very seriously. People should keep their money (earned by trading time from their lives), and use it to make the most of their own lives.
Moral credit ought to go to those who create the most, not to those that give up everything. Contrary to what your mother will tell you, giving money to charity does not make you a better person. But creating things and otherwise making the most of your life (you only have one), does.
If you want to give money to charity, make sure you're doing it for the right reason (i.e., because you know that the specific cause you're supporting will make your own life better), and that you have enough money so that you're not sacrificing your primary values (your own goals, family, friends, for example) by doing so.
Don't give up the one life you have, or any part of it - it's yours, and it's all you've got.