Hacker News Reader

And it failed at that. As the text gets longer and longer, the lack of synthesis across the contexts you've glued together becomes ever more glaring. It's a decent hack but not a solution. More research is needed for how to forget properly across long contexts.

View on HN

To be fair, one of the earlier comments said "I wouldn't build a summarisation startup on top of GPT3". But it seems like GPT3 is more than capable of producing summaries that are passable, and would be far cheaper than humans. It does seem feasible that one could build a startup based on that

I assume you’re familiar with this, but if not: https://openai.com/blog/summarizing-books/

Familiar with it. But as they themselves say,the fine tuned model(not released) achieves 5/7 rating for only 15% of the time. So 85% of the time the results are not satisfactory.

Wow, didn’t notice it was that low. Thanks for walking me through this — I might try to tackle this problem next. Very interesting.

Reply on news.ycombinator.com