182 karma · joined September 3, 2022
---
meet.hn/city/ca-Vancouver
Socials: - github.com/yakhinvadim - x.com/yakhinvadim
---
I don't like the word "top" because even on the most uneventful day there's going to be something that qualifies as top (because of the lack of competition).
So proper term would probably be "globally significant news" or "news significant to humanity as a whole".
> For each article ChatGPT estimates:
> Magnitude: how big was the effect;
> Scale: how many people the event affected;
> Potential: how likely is it that the event will cause bigger events;
> Credibility: how credible is the source.
Then I do `Credibility * cbrt(Magnitude * Scale * Potential)`
cbrt = cubic root
Maybe the formula could be improved but I was satisfied with the result, so kept it that way.
Will try to improve it.
Added "good RSS" to the TODOs.
I did it at first, but quickly realized that it's too expensive. GPT-4 is 15 times more expensive for prompt and 30 times more expensive for completion than GPT-3.5-turbo. But I think GPT-3.5-turbo gives 90% as good summaries as GPT-4.
Every time ChatGPT saw the words "World is ending" (not real example) it gave those articles very high score.
Estimating source credibility was the only solution I came up with.
> Have you made any attempt at quantifying its biases?
I haven't. I can share ChatGPT's evaluation of sources credibility, maybe that will give people some insights. For example, Reuters got 9.5 (out of 10), Lifehacker 7, Oprah Mag 3.
> where it focuses most of its reporting. (Economy and the US from a first glance?)
I'd say today is just US and economy-heavy day. There were many days when other categories and geographies made the top (I especially enjoy these). One example: https://newsletter.newsminimalist.com/p/tuesday-april-25-3-m...
Adding filter for news sources should be pretty easy, I'll consider it for "advanced view".
As you said analyzing news in other languages should help with bringing up different perspectives. I'll work on that.
But I'm still not sure what to do about chatgpt's bias. For now I just accept it.
I just ask chatgpt to "summarize the article very concisely" and hope that it won't lose any important points. But chatgpt is really good at summarizing, so I don't worry much.
Having +/- buttons is a good idea, will add it to todo list as well.
Recent example: https://newsletter.newsminimalist.com/p/tuesday-april-25-3-m...
I have no control over it, but let me know if there are any problems with it — I'll see what I can do.
The problem with deduping is that some news get posted and reposted by different sources for several days (sometimes even weeks) in a row. That's a huge context I'd have to put in AI.
1000 news titles * 3 days * 70 symbols per title = 210,000 symbols = 40000 words = 53000 tokens. My current context window is 8000 tokens and I think 32000 tokens is max that GPT-4 allows.
---
Add: now that I think about it should be possible to do in several runs. Will keep thinking about it, thanks for the suggestion.