Why? There's no free speech environment if it lacks spaces that upset you for existing. X's existence in the name of "freedom", even if you disagree with the characterization, in turn protects your free speech. In fact, nothing else really does.
btw freedom of speech doesn't exist anywhere to begin with. Even in the self proclaimed "land of the free" you can't swear on public tv lmao, libel, slander, obscenity, fraud, &c. are all illegal. Meanwhile nobody talks about freedom of press even though the US ranks closer to Hungary than western europe, so much for freedom of speech...
Reminder that twitter is a bubble in the internet, which itself also is a bubble, and that real life exists out there.