Now my argument may sound like political correctness, but it's not for a few reasons. You avoid prejudice by avoiding topics of gender, race, etc. You ensure people have the opportunity, which doesn't guarantee an outcome. You don't need equal numbers, just don't alienate. These 3 things encapsulate my beliefs and are the antithesis of political correctness.
So, you are right in that individuals should have the right to their views and should expect them to be challenged. Also recognise that Facebook and co will magnetise these marginalisers to each other, giving them a collective voice which can easily turn into a mob (as it often does). If you don't have responsible leadership (and we don't), these mobs become vicious and destructive. Compound this with political correctness and you have a toxic, self righteous and highly prejudiced mob of hate and bullying!
With policies of both US candidates being so openly prejudiced (eg. Trump on Mexicans, Clinton on her gender card), the future for more hate and bullying looks certain.