What you are talking about is social darwinism, not simply natural selection, and I think there has been enough said on why it is problematic that I don't need to reiterate it here.
"Natural" != "morally right"
But it isn't.
And, in case this was a point of confusion, race != family.