Is this seriously a thing in the US? Feeling like you have to drink if you're surrounded by people drinking? I keep hearing stories like that. Nobody is going to judge you for not consuming alcohol - if anyone does, they're certainly not people I'd want to hang out with regardless of whether drinks are involved.
It doesn't hurt not to give a fuck, once in a while.