Why do you grant "academic freedom" some sort of special status, while decrying freedom of speech? Yes, Americans tend to confuse the legal principle with the ethical one, but both are equally valid.
Freedom of speech is certainly a valid thing. But as a legal principle, it refers to restrictions on government, and Yale is a private institution. If Mr. Haufler wants his effort to succeed, then I think he is better off using the proper terminology.