Letta: Letta is a framework for creating LLM services with memory
github.com
github.com
He is highly functional, able to multiply two digit numbers in his head and run heavy equipment on his farm. But he'll ask you the same question, five minutes after he asked it the last time. He'll forget what neighbor just visited him the day before, or whether he called the gas company to refill his propane barrel.
I believe that a voice interactive LLM with memory could be extremely helpful to him and to other elderly people. He could use it as a daily log, telling it things that have occurred, and then interrogate it later. In truth, who among us could not benefit from such a system, even in our younger years?
This framework looks interesting to use for such a project. Are there any other people working on similar things?
Our team has been working really hard on a low-latency voice integration that enables (open source) "advanced voice mode", but with long-term memory!
If you're interested definitely hop in our Discord to keep track of dev progress (you can also monitor our docs). It's all OSS of course, so you can use it with any model you want and run it all locally (your agent data stays on device).
Once available you can definitely use Letta for this usecase - basically provision a stateful Letta agent for your dad, with instructions / prompting that your dad has memory loss issues, and the agent should be proactive in recording memories (and potentially jogging your dad's memory too). All the memory/state will be stored in postgres, so you can expose it to other tools as well, eg could even collate the memories into a nextjs/mobile app where you dad can browse them.
-charles from letta
Fun facts in Arabic, "insan" meaning human being or mankind. This word takes its root from the word "nisyan", which literally means “forgetfulness”.
[1] Lethe:
https://en.wikipedia.org/wiki/Lethe
[2] Arabic for forgetfulness:
There are two linguistic theories: the one you mention, and the other which is from “uns” (أنس) which means “companionship” or “affection.”
While both explanations have historical significance, the stronger linguistic evidence points to the latter explanation (companionship or sociability) by Classical Arabic linguists. The former (forget) is a more recent interpretation linked to philosophical and theological discussions rather than libguistic roots.
Edit: just found this etymological trail for insan:
>From Proto-Semitic *ʔināš- (“man, person”). Has the form of a verbal noun , as if from أَنِسَ (ʔanisa, “to sense (visually or auditorily)”).
If you implement this persistent memory via tool use, then it's related to inserting/querying databases, because some agent has to read/write to a data store (potentially backed by a database) to maintain memories.
-charles from letta
IMO, the main value (as an agent / AI developer) that you get from MCP is another style of tool repository. Similar to how it's nice to have pre-made tools (eg Composio), MCP servers are another repo of tools to pull from (you just need to add MCP client functionality to your agent loop). So if a ton of energy is going into building MCP servers, might as well add MCP client support so that you can take advantage of the additional tools.
-charles from letta
https://en.wikipedia.org/wiki/List_of_Tron_characters#Master_Control_Program
The Master Control Program (MCP) ... is the main digital antagonist of the first Tron film.To clarify - by "it", I mean making Letta agents an MCP client, so that you can easily connect to MCP servers as tools (not the other way around, where Letta itself is an MCP server - if you want that, someone in the community already made one: https://github.com/oculairmedia/Letta-MCP-server)
-charles from letta