Memory compaction for agents has an information-theoretic floor
pentad.ai
pentad.ai
I ran the same probes against Wunderblock, which is based on vector-symbolic architecture, and got 84% of the floor with no LLM at all. Bloom filters sit at 55%.
LLMs are overused!