I take issue with the "nor should they" aspect of what you said. While I'm aware it's not a binding document, the United States [1] claims that these rights should be inalienable. This, to me, would imply that these rights should apply to everyone.
Obviously this gets into more nebulous territory if the person isn't within the states, but I still fundamentally think the right to free speech should apply.
EDIT: [1] Declaration of Independence.