It's not a question of what people "mind" or "don't mind", it's a question of what level of risk people will accept in order to live a normal life. Hiding away from people may reduce risk in a lot of ways, but most people find it unacceptable.

Before COVID, I was under the impression that most Americans found "Give me liberty or give me death" an admirable sentiment. But it turns out that I was mistaken about that.