If you have a famine or a war or serious poverty, or it is effecting young children, then I think we should put everything else aside and give and volunteer until it hurts.
If on the other hand we have some nasty person who lives on your front porch drinking himself unconscious every afternoon, I don't want them to be fed or clothed. I want life to be as painful as we can make it for them so that they either change their behavior or die more quickly. It's harsh, but I don't see why someone has the right to degrade the lives of everyone around them and have those very people feed and clothe them. If we can offer people help that is effective, we should offer it, even if it is expensive, but otherwise we shouldn't feel guilty about trying to keep nasty people away from our families and ourselves.