The simplest take is that “white people are not diverse”. So by asking for diverse group means non-white. Predominantly because diversity is _within a dominating white culture with a surplus of non-white people_. It is basically labeling and contextual issue, not intentional. Imagine asking for a diverse IT office in Zimbabve - is the adjective “diverse” the same as in San Francisco?