Obviously.

White privilege absolutely exists, and it should absolutely be discussed, but in the context of politics, it’s an implied message of, “your problems aren’t significant and you should get over it.” Whether or not what’s objectively true has no bearing on how it makes people feel and how, then, they will perceive the person speaking.

A better approach is to focus on shared problems, but perhaps give a bit more attention to those with particular hardships or barriers.