To be clear, I don’t think this reaction is irrational at all. I’m curious though why you do.
People also walk around with their phones out so often. There's no way for you to know that they aren't recording. E.g. someone could easily be pretending to use their phone when climbing stairs while actually taking upskirt shots with the front camera.
Social media is also already full of people shamelessly recording others in situations where they would not want to be recorded.
Actual perverts have little reason to use these glasses specifically, and as mentioned in my previous post, the cameras have utility other than recording others.
If you're a pervert, you wouldn't want the victim to know you're recording them
If you don't want someone to know you're recording them, you wouldn't wear the famous Recording Glasses
But I don't know, maybe I'm overestimating the average pervert