Is that a scene that makes more sense in context? Out of context, I'm having somewhat of a hard time distinguishing it from a bad composition.
(Unintentionally reduced spoilers due to having forgotten many details of the film.)
Look again at the actors. Smiley never stops studying the others' face, while the other looks scared, nervous, shifty, and guilty the entire time. Even without context you should be able to pick up that Smiley is cool as ice, and that the other man has something to hide.