Yes, I used to visit a lot for business, and would love to go back on holiday too, but at this rate I'm not sure I want to. So far it's mostly been that I don't really have a compelling reason to visit, and it's just been tipping the scales in favor of other vacation locations etc., but the more stuff like this, the less attractive it gets.
It doesn't even need to affect me directly - it just contributes to an overall impression of not being welcome.