It makes all the difference in the world. If people are poor because that's the best they're genetically equipped to do, then there's not much we can do about it.
Look at pigeons. They eat out of garbage cans. They die within a few years. They get run over by cars rather a lot. But we don't really worry about this, because they're just fucking pigeons.