I'm very deeply concerned about privacy, but a simple thing like an "on" or "recording" light on the glasses could alert people that recording is on.
It's fine in situations where consent is obtained in advance; e.g., events.
I should add that I take more pictures than the average person, and used to be a street photographer, so I have been in situations where people did not want their likeness captured. Also in countries where people objected to photography altogether on the grounds that it stole their spirit. I always had to make a decision with my trigger finger, so I was able to apply human oversight. My stance is informed by experience.
Edit: OP removed their reference to punching people who would dare film them. This thread will no longer make sense to other's trying to catch up.
Don't squander your right to record in public on something as mundane and personal as a civilian minding his own business. Record a crime, at least. Otherwise the law may change and you may lose that "right".
I also think in some countries it might be illegal to record someone either video or audio without explicitly telling or asking for permission. Even at the airport (at least in many I have been) it was not allowed to do video recording
There are, but they are extraordinarly unlikely. People push and shove each other all the time over minor insults and disagreements and almost never end up in front of a judge. Most cops would just say "you should have put the camera down when he asked you to, now stop wasting my time."