But also, it's just a different type of victim blaming. Anytime perception is allowed to be blamed, logic goes out the window.
The same excuse was (is) used against minorites for years: if they don't want me to feel threatened by them, then they shouldn't be (perceived as being) so threatening.
It's why any type of "thought crime" is so dangerous. It doesn't matter what you (the accused) actually think; it matters what someone else thinks/perceives what you thought.
Which means that what someone else thinks of you can make you actually guilty of a crime.