How is one to be sure what makes others uncomfortable? In your view, in th years after 9/11, Sikhs (who wear turbans) shouldn't have traveled at all... as they looked too much like the dreaded Bin Laden.

This way leads to fundamentalism.

Logical inference does not work the way you'd like.