You could use arguments easily on the same moral parallels are those to exclude particular races, sexes, etc. I’m not calling you out - I think you’re correct actually, in the observation. But some biases are more politically and culturally palatable than others, even when there isn’t a whole lot of daylight between them.