This is a problem you have to solve yourself, without relying on making facial scanning and profiling tech widespread.

The simple solution is that you live with the small amount of awkwardness this generates.