"Anti-diversity" is a rather uncharitable term to use; it takes people who, say, dislike bullying tactics or prefer meritocracy and lumps them in with racists. One reason threads on the topic often degrade into flame wars is the attitude that there is only one moral way to view the situation.