My neighbor is a wealthy white male and I'm willing to bet he's less like you than your female friends of color are.
The problem with this kind of identity framing is that politics is central to it. One wrong step and your enemies of color (for instance) may play their victimhood against your prosperity and it'll become brutally obvious how political you are by merely existing within a demographic.