It's just that it's very hard to determine what's 'wrong' and what's not, other than very extreme cases and even then you might disagree. Banning some media because you don't consider right/worthy/beneficial/whatever doesn't help with free speech at all.

Imagine someone banning Justin Bieber music because it's not 'worth listening', or banning some books because they have no value. That's a bit absurd.