Probably an unpopular point on HN, but this is very gendered. There's a lot of women who don't want to be chatted up who wear headphones, and therefore a lot of men who are annoyed at this visible signal that the woman doesn't want to listen to them.
We can leave room for "not wearing headphones is a signal that you're open to talk" without having to pressure people who aren't.