And you'd justifiably tell them to not do it...

And if you are not able to stop them from doing that, may I suggest you have a bigger problem with your government or the security guards than being tracked by them?

Again: Tracking personal data is regulateable, facial recognition technology is not.

And the mere act of checking the identity of a person for legitimate access control purposes is no unreasonable infringement on privacy.