what about "collective" cultures that don't prize individualism? If you are discouraged from saying something because it will cause social disharmony within your community, is that as morally wrong as slavery?
I think not.
I think capturing someone from their home, their country, their loved ones, transporting them across an ocean, beating them, making them work for the rest of their lives without pay, while starving them, raping them, and imprisoning them, is a long, long, long way more morally wrong than not letting idiots spout whatever crappy opinion happens to wander across what passes for their mind, regardless of what damage it causes.