I have actually done some work with doc2vec. What is in these text data? What do you hope to extract?