Often, people will think less of you. I have a 'straightedge' tattoo on my back, and even though I'd go to bars, never mention it, and just drink Coke, others felt that by not drinking I was judging them. I lost friends over it.
I drink now. Possibly too much.