On the one hand I agree with you: some people face disadvantages and don't see role models, in tech conferences and other contexts, like actual jobs.
On the other hand that isn't fixed by buckling to vague accusations, attempts to ostracize supposed offenders, or enforcing rules of behavior that restrict who people are. Bias and exclusivity are real problems in tech conferences, in the industry as a whole, and in real life. Changing social norms has to be an organic process, not a battle of grievances and petty punishments and social media smearing.
I've been to conferences where people I don't want to listen to are speaking. I just don't go to their presentations. I'd like to think that when I pay to attend a conference the speakers and topics are chosen for relevance and quality. I'd also like to believe that everyone has an equal chance to get on the speaker list, by considering what they have to offer and how well they can present it, and not considering their personal disadvantages. We all have personal disadvantages, and favoring some over others changes worthwhile goals (respect, opportunity, inclusion) into bickering and vindictiveness.