Here in America, I believe you can refuse them, as l long as they aren't a protected class.
But should you?absolutely not. Even if they were the kkk. You are talking about Free Speech. And while that is between us and government, I believe Free Speech is the cornerstone to democracy, and each and everyone of us should strive to support Free Speech. Even if that means supporting speech we don't like. You may not agree with what someone is saying, but you sound right for their right to say it.
In this day people seem to be fighting against the right of free speech, especially speech they don't like.