Hacker News Reader

I wonder if you split the corpus and only used low voted questions/answers for one corpus and edited questions + high-voted answers for the other ... could we tell the difference in the output chains?

SE often has translated questions, or questions of low quality, IME.

View on HN

In a way I did it for Stack Overflow. All Posts are 60GB which is a bit too much to handle the whole chain in my desktop-pc. So I only used questions and answers with a score >=10 there to get it to a similar size as the other sites. It still took half an hour to parse the XML and another hour to create the chain.

Reply on news.ycombinator.com