If you truly do believe in a table for rational discussion all ideas should be considered regardless of how far-out they may seen. By banning various controversial figures from one side, but allowing other controversial figures from the other side to continue, is diametrically opposed to the idea of "open discussion" you claim to be supporting in your argument.
You may not care. But then you are not a proponent of free speech on a platform. When the platform becomes a global nerve center for content the argument "they are a private company and can do what they want" must be looked at with significantly more scrutiny. It would be extremely naive to not believe that YouTube not only knows they have this level of control, but are actively seeking to exploit it.