Learning to summarize from human feedback (2022)
arxiv.org
arxiv.org
They released code, models and raw data here: https://github.com/openai/summarize-from-feedback
For example, train a model(s) by reading every single article (including paywall/cache replacement) of https://www.techmeme.com/river https://www.mediagazer.com/river https://www.memeorandum.com/river https://www.wesmirch.com/river https://ballbug.com/river and comparing it to the summary headline.
https://www.businessinsider.com/techmeme-growth-2014-3
The river is the reverse chronological order similar to https://hckrnews.com
If you go back to the main page of tech meme, and hover over a story an arrow will appear on the left. Click it to see follow up stories to the first story.
The first two techmeme and mediagazer at least, do headline rewriting to debuzzfeed/deupworthy clickbait headlines. https://finance.yahoo.com/news/aggregators-attack-techmeme-h... https://www.poynter.org/reporting-editing/2015/techmeme-is-p...
There's a dataset that would help there.
> Open AI
> We collect a large, high-quality dataset of human comparisons between summaries, train a model to predict the human-preferred summary, and use that model as a reward function to fine-tune a summarization policy using reinforcement learning. We apply our method to a version of the TL;DR dataset of Reddit posts and find that our models significantly outperform both human reference summaries and much larger models fine-tuned with supervised learning alone.
tl;dr^2 they did ChatGPT to summaries
This makes me think that to get high quality summaries: 1) they have to be generated for each individual reader 2) the AI should know what the reader knows
You achieved 2 by imagining what HN people may already know, but the ultimate goal would be to know what the individual reader knows.
And this chain of thought leads to - Perhaps all AI output should be generated on the fly for the end user with full (relevant and compressed) context. - Giving AI what we know is extremely dangerous if someone wants to use it for something bad (so we really, really need local AI).
Sure, these are all things people in the industry already know, but there must be a lot of people like me who are just now thinking about it.
A note: "^2" added humor to make the reading light with very few bytes. Perhaps the machine would do this too, if the reader wants.
Only few things make me very very excited and sometimes very very sad like some AI developments. But the exciting part wins for now!
Being able to generate summaries at various levels of depth would be a great efficiency to consuming a lot of content. No more skimming through articles and books written like the author was paid by the character. But if you want more depth, it’s there. Like an LoD slider for information