Then why is yelling "fire" in a crowded theatre illegal? With your reasoning you should just be able to 'fight that idea with saying "No there is NOT a fire" but it's too late, the damage is done.
https://en.wikipedia.org/wiki/Schenck_v._United_States#The_C...