I wonder if there might be a way to generate a dictionary definition based on a word2vec vector? It would be cool to generate a word that's halfway between two other words, or to complete an analogy.
Another idea is to generate word vectors from a dictionary. Instead of trying to infer it's meaning from context, a dictionary gives you it's meaning directly. And even alternate meanings. Or a hybrid approach might be best. I recently read a paper where they used wordnet relationships to improve regular word2vec vectors a lot.