I like your logic. "You know, I have never been a victim of a murder, therefore murders don't happen".
When a company publicly announces "we're affirmative action company", I understand it as they openly exercise racism and/or sexism against me.
And trust me, as a divorced guy, I've experienced institutionalized sexism A LOT.