I'm not sure. I think it depends whether the not drinking till some ages is self-imposed, or externaly imposed, and how much external that prohibition is.
For example I weren't drinking till 18, because I was very religious in primary/secondary school, and priests encouraged promising to yourselves to never drink till 18. Most people didn't care, I did (religion is nice mind-hack, btw, it's a shame it stops working when you don't believe it anymore).
So I had to learn to party without alcohol, and I did. Some people were unfriendly because of that, but I figured they were obviously dumb, if me not drinking spoils their fun, so I won't care about them.
Then I got 18, go to university, and drink alcohol like everybody, but never feel the need to drink too much. As for now I'm 28, and I've never had hangover, or lost memory. And I was partying hard at university.
In my country you can buy alcohol from 18, but enforcement is not very strict, so kids start drinking in primary school, because it's cool, because you're gambling system. Of course most people grow up eventually. Binge drinking is a part of culture (well, wódka is Polish/Russian invention :) ), but young people prefer beer, and you have to really want to got drunk, when drinking beer, to got drunk.
I think it more depends on the attitude and example of parents (mine had drink on occasions, but I've never seen my parents drunk. They also never made the alcohol sound like it's some great forbidden fruit they had to protect me from).