Show HN: Summarized Finance / Tech Newsletter Using Natural Language Processing
getthecrypt.com
getthecrypt.com
Honestly, we still need more testing.
However, our top 3 tend to usually be Luhn's Heuristic Method, Latent Sentiment Analysis, and TextRank.
On the other hand, we have yet to use a single summary produced solely using SumBasic... I'll need to read into that one more.
No doubt neutral reporting is advantageous; personally I would find it helpful to also see both a highly positive and negative take. Coming at a topic from both high and low may, imho, improve accuracy of comprehension.
For the semantic analysis process, we are using Microsoft's API - scores from 0-1. And for the most part, it is pretty good based on our views on neutrality (which of course has some inherent biases).
0.5 is considered pretty indifferent, however, we allow for a threshold of 0.35 - 0.75 as neutral, but we specify it's lean on our end.
On Reddit, we've tested our summaries in the comments for tl;dr and we actually indicate the articles lean for example "This article is neutral with a negative lean on the topic".
In Finance, top publications do a great job on maintaining neutrality. However, if we ever get into politics... we'll need to take this a little more seriously!
Thanks for the comment.