Hacker News Reader

The idea is that you create a summary with sufficient details, or you trim things away, depending on the method, but you do in fact lose exact details.

The impacts of this are not well known and likely depend on model, harness, and session. (hunch)

View on HN

So it does forward pass once again to get the summary from the whole session as input?

There are a lot of things people do, but I don't think a forward pass is the right way to think about it, think more agent than llm

Reply on news.ycombinator.com