Adams is talking about white political elites rather than white academics, but as Elizabeth Warren illustrates, there’s a lot of ideological overlap between the two.
I'm not saying you're wrong, but I'm completely baffled by how you've managed to reach the opposite conclusion to the one I'd expect.
Thus, advocacy that purports to attack “white elites” can nonetheless take power away from minorities and give it to elite whites. Historically, advocacy on behalf of minority groups was done by minority groups themselves. For example, the black civil rights movement was closely tied to black churches. Today, such advocacy has been increasingly taken over by white elites. BLM is funded mainly by affluent white people. Ibram Kendi was selected to be a professor at BU by an overwhelmingly white faculty. Or to use another example, consider MacKenzie Bezos giving tens of millions of dollars to “AAPI” activist organizations. Those groups don’t answer to recent Chinese and Bangladeshi immigrants in Queens. Their whole incentive structure is oriented toward appealing to rich white people like MacKenzie Bezos.
The net effect of that is that much advocacy that claims to empower minorities actually ends up taking power away from minorities and empowering white elites. You can see this clearly in New York City, where white people in Manhattan strongly opposed Eric Adams, and so did minority activist groups. But actual minorities overwhelmingly voted for him. But in many, many cases, minorities don’t get to directly weigh in like that. Instead white-dominated institutions act on behalf of minorities, based on their own ideological preferences.
Identity politics is gleefully adopted by the elite institutions, and the base of resistance against it is working class.