We do have, though, concrete empirical evidence of the eventual consequences of casually thinking of and referring to others, any others at all, as 'human garbage'.
The moral status of that line of thought is much more clear - it's noxious and if there's some sort of moral thing we ought to agree on is that it's to be rejected and opposed, wherever it pops up.
[Edit: and to completely Godwin up this thread - if there's a day to take 30 seconds to think about the implications of such rhetoric, today, V-E day, is a good one].