> is it fair to curtail speech because someone might perceive it as a threat?

Plenty of speech is criminally curtailed. Credible threats of imminent violence. Fraud. Perjury. They’re just tightly defined ex ante.