I've noticed the same thing. How could they possible know that I know of these people I see. Perhaps they do look at who I view, and who views me.

Its quite disturbing, but at the same time fairly impressive. I'm very curious.