Each token would have one vector from word2vec. A token could be a word or phrase depending on the pre-processing. The words in a phrase are usually concatenated with an underscore. I recommend gensim if want/need phrases.
But it seems it's been solved, too: https://github.com/sbos/AdaGram.jl