You're presenting a false dichotomy. Of course, there will be mistakes. And of course there needs to be moderation. But I support the moderation similar to HN, it's about politeness and respect. As long as you're respectful, you can say your piece.
Also, X does provide community based fact checking too, which works best when there are representatives from all sides participating.