Assume they are insecure and looking for a passive-aggressive way to cut you down to their level. The British^W English are quite adept at doing this in a way where you won't realize until the next day that they were insulting you.
It is better to remain cordial as they 'banter' at you, but to never reciprocate.