Except for the non-drinkers in your team. I suspect that they either
a) feel left out, because a non-drinker at a pub has a boring time, and has to keep justifying their empty glass
b) probably miss out on important decisions if a majority of the important people in a team are present, which is bad dynamics
c) maybe your team doesn't have any non-drinkers. What does that tell you in terms of diversity / inclusiveness?
I'm not pointing fingers at you specifically because you mention explicitly making plans around people who don't/won't drink, but i think there should be more awareness around this, especially since it can seep into the culture quite insidiously, and invisibly.