And here I am trying not to look pissed off at everyone around me because they're sitting there doing little to no work, talking, and making noises.
We also use slack and 'idle-ping' other team members first and keep conversations in slack if possible. This works quite well, too.
Recently we had an intern, which had a very annoying tic: While listening to headphones he now and then started to sing/whistle/hiss along, quietly but audible. It's strange and a personality thing, but it took quite a few days until I snapped and told him to stop. It also started again after a couple of days and I had to tell him again.
There a two things to note: For some people it takes a lot to complain about something and for some people it takes a lot to change a habit. In a large office this can be problematic.
I shall confess that I'm guilty of this, too. It helps, though, that everyone in our open-plan office has good headphones, so usually not too many people notice.
(And yes, I realize the bizarreness of this entire situation.)