I find that often when I wear headphones, it makes the noise of co-workers more annoying. Without the headphones, I can hear distracting conversations, but I also hear other assorted office sounds, and the wind outside.

With the headphones, I hear music, but I can still hear some of the conversations, but none of the other noise.

Since the conversation doesn't fit in with the music, and I'm missing the other office noises that at least make me subconsciously think of the conversation as background office noise, it ends up forcing itself to my attention more than when I'm not wearing the headphones.

Anyone know if active noise canceling headphones would help much? I've read that they don't do that well on canceling conversation.