HNHacker News
TopNewBestAskShowJobs

divitsheth

27 karma · joined August 28, 2024

submissionscomments
divitsheth··on Show HN: CodeAlmanac – Karpathy-style codebase wiki from your conversations
Would love to hear your thoughts and appreciate public contribution.
divitsheth··on Show HN: CodeAlmanac – Karpathy-style codebase wiki from your conversations
Glad you liked it! Would love to chat more about what kind of production workflows you are looking to improve. You could grab whichever time is convenient for you: https://cal.com/team/almanac/demo
divitsheth··on Show HN: CodeAlmanac – Karpathy-style codebase wiki from your conversations
We’re working on evals now. We ran a small preliminary LoCoMo test with a 2k-token retrieval budget:

Almanac: 55.7% BM25: 51.8% Supermemory: 47.6% Mem0: 60.6%

LoCoMo is not quite our use case. It tests conversational memory, while Almanac is more for coding agents trying to find their way around a codebase.

These results show output quality at the same token budget, not token savings yet. We’re working on coding agent evals that should be more representative.