For me to know your view, you must have expressed it in some manner. That implies an action on your part. For me to know your gender or race, you simply need to exist, and must actively work to hide either.
Expressing their view took action, and their actions can affect me.