I agree that the relevance of retrieved pieces and the management of long-term storage could be improved, though.
I agree that the relevance of retrieved pieces and the management of long-term storage could be improved, though.
If someone only remembered vague scraps of what you'd expect them to remember, you might say the person can't remember.
It's much closer to notetaking and reviewing before responding than it is memory.
The issue with anthropomorphizing like this is that "memory" comes with baggage of expectations for it to do certain things, and it breaks them.
Just like "thinking" implies chain of thought, but you'll frequently get those reasoning traces and then a 180 in the final message.
But billions of dollars are going towards research to find these breakthroughs, so we'll get there eventually.
Be me, think extensively about an exam question, do 180 because the most probable option is just too obvious to be true (no, this part wasn't verbalized, it's how I describe what I felt about making the decision to do 180, or maybe it's a rationalization and it was a natural analog of an unfortunate sample from a probability distribution).
The layman’s understanding I have of memory, as someone that has dealt with memory issues much of my life, is that memory formation is heavily tied to emotions. emotions are triggered by input which sends a complex set of signals throughout the brain - you’re not just finding where in your head to store this, your brain is deciding how important it is, and what else to correlate it with - so it can tie them to other related memories. then on top of all this, much of the sensory experience you intake is subconsciously compared against high priority memory impressions and deciding what to pay attention to.
you could, argue that the sensory input is the simple md files and the emotional mechanism is the same effect as to how attention mechanisms work in llm’s. Ok, I can almost buy that, but these tools lack a fundamental ability to decide how important things are.
an analogy. you tell a person “if you pick a daisy in the next five years, an assassin will come to kill you” and they hold a knife to your throat while they say it, your brain whether you like it or not is going to say “THIS IS AN IMPORTANT MEMORY I NEVER MUST FORGET” and you’ll see something that looks like a daisy and have a panic attack 3 years later. that memory is never fo tell me claude or other tool harnesses using memory harnesses can prioritize memories the way that human would, instead they forget even when reminded, because the human brain is just so much better at it