Agreed. The gesture of glancing at one's watch or wrist during a conversation carries a very particular connotation, probably going back generations.