I had a woman just flat out turn on her heels and walk away from me upon mention of my service (I forget how it was related to the conversation). We were having a professional conversation at a conference. I've gotten looks of disgust from students (I teach various programming classes) when I tie something back to a lesson I learned in the military. Whatever.
That stuff doesn't affect me. It's more a reflection on them than it is me.