Aside from the xkcd, this 'everybody knows' effect can be domain specific. The people who hired the pinkertons, and any party interested in stealing corporate secrets, know who they are.