I think the central question for a such memory system is whether we or the agents can find the relevant information and how to organize these data as changes continues to come in. Would we miss something in the retrieval process? How do we organize the information so they stay actual and correct without piling up the garbage? Of course we can continue to concatenate the data and tag them with version and date, but then we have to face the problem of extracting the relevant information in a short time. If we delegate that problem to a LLM, long context retrieval performance will degrade and the cost will explode.

That is the reason why we condense the information in the first place. Forgetting + Synthesizing are the necessary parts of learning and basically with memory + smart retrieval we want to build a learning system.