>I really don't understand this idea that speech doesn't have consequences that cause disparate impact.

It seems you are tilting at windmills. Where in this discussion has anyone claimed that words do not have effects?