Except that it is. What passes as a cold, rational analysis of cold, scientific facts is rooted on traditionalist biases of the conservative mindsets of scientists in the XIXth century, when the basis of our social sciences were being established. Colonialism and sexism were seen as common-sense a prioris, and those positions permeate a lot of the reasonings and conclusions achieved in these sciences without being put to test (see e.g. myths about the primitive hunter men and gatherer women, or how money originates from barter, which are passed as truisms when studying these disciplines without questioning).

Colonialism and sexism are inherently anti-diversity; and people stating those opinions and usually unable to see how their position derivates from those premises.