My anecdotal experience from discussing these issues with people of many demographics, political pursuations, etc. is that there is a great deal of animosity from people that were more heavily hit by the lockdowns, rules, etc. imposed by the goverment. And people wearing masks is a "signal" that that person is likely on the side that was driving the lockdowns, restrictions, etc. to occur. This includes: people that have lost their jobs, people that have young kids (in schools that were closed), etc.