This is narrowly true, but broadly false. The concept of 'white privledge' relates to the concept of 'white man's burden', which is european in origin. Nobody debates that indians, japanese, and other asian societies aren't highly adept at elitism.

White privilege is just one type of privilege, it's not the only one. Rich white guys get two sorts of privilege - not only are police less likely to stop them because of their race (for instance), if they do get stopped they will be better able to defend themselves in a legal manner (because of their wealth and probable education levels).

Whereas a poor white kid might be less likely to be stopped, but also not really able to defend themselves if they are stopped.

Finally, a poor black kid is more likely to get stopped and not really able to defend themselves if they are stopped.

no one ever said there was. There's just a statistically higher likelihood of being privileged if one is white.