Some northern Scandinavian people and especially the Finns do without it.
I tried having comfortable silences with my coworkers. Some like it, some just go insane. It kind of depends on the person - maybe some people never learn to appreciate the silence.