The same reason most of us can't address customers and colleagues as idiots.

Employers fire employees who speak offensively even outside of work. Free speech doesn't mean speech without consequences.