Right, they know where the transaction is taking place. The point is that they can have much higher confidence that the card hasn't been stolen (or cloned, in the case of mag stripes) if your phone is also in the same zip code.