I've experienced that as well.

An additional challenge for me is that I don't like the taste of alcohol, and having even a little makes me do/say things that I later regret.

So even when I do show up at company social events, I feel even more like an outsider. It's hard to stay engaged at a job where all of these team-building events / milestone-celebrations make me feel lonely and excluded.