For most people it's not

The expression "privilege" itself makes people feel attacked and get defensive. If you say the same exact sentence replacing "privilege" for the definition and it greatly changes how people react to what you say

That's a good point. There's absolutely no reason to feel bad about being privileged. You should be happy! Perhaps spread some of that happiness around, make the world a happier place. Everyone wins.