Classifying blatant racism under free speech can have actual consequences too. Consider the genocide in Rwanda in which racist radio programmes encouraged massive killings. You could say that everyone's responsible for their own actions, nobody forced anyone to grab machettes and kill their neighbours, but somehow that argument falls apart when you're dealing with mass hysteria.