Could we have a "Men of Irish Descent" group? I suspect that would cause all kinds of cries of racism and sexism.
There's this strange sort of argument that some groups (men, white people, cis people, thin people, etc) have some kind of ephemeral power and therefore should be denied certain privileges like forming exclusive groups - but these privileges are ok for some other people. That's not equality in any sense of the word.