That is your distinction because you chose to draw the line around all humans. But who is to say that the line shouldn't be drawn around black-people, or just men, or just Christians?

And no, taxes don't just magically benefit everyone. It's actually the point of them, that they are redistributive.