It's common to have cameras mounted to record you typing your PIN along with skimming your card. It's good practice to cover the pad with your other hand.
I still don't know how they got my pin. I can't imagine anyone looking at my pin in a restaurant. It seems like such a hard and non-scalable way to do this kind of thing.