I wear one everytime I fly (which is 8-10 times a month on average) and I just don‘t care about the reactions.
Also, keep your bare hands the hell away from your eyes and nose.
If I'm desperate, I rub them with some piece of clothing that's not much exposed to the air, such as the inside of my t-shirt. Or alternatively, washing my hands carefully with soap and water immediately before rubbing my eyes.
I can't say for sure if those measures helped, but it seems plausible based on my experience.
It takes years to develop that level of attentiveness, but it's oh-so-worth-it. And not just because it lets you avoid the seasonal colds :)