133 karma · joined September 29, 2014
Discusses some issues raised in this thread.
But pushing a signal below the noise floor is analogous to tombstoning a tuple in a database.
Inlike vector databases that append embeddings to an HNSW graph, my working memory substrate natively supports mathematical forgetting.
I use a Squelch primitive—a SIMD-parallelized saturating subtraction over an 8-bit probabilistic accumulator.
When an agent finishes a chain-of-thought, we literally subtract the statistical mass of that specific reasoning path out of the 16,384-dimensional superposition.
It intentionally drops the signal back below the Kanerva noise floor, freeing up capacity in the L3 cache without destroying the other superposed facts. It works similarly for episodic memory and procedural memory.
Semantic memory, currently, is for invariants and “the schema” so no “deletions” but this will likely be reworked.
As for retrieval, yeah similarity via Hamming is table stakes. But there’s other stuff too including resonator network factorization and a Datalog variant, too.
We map Datalog semantics directly to VSA using 16,384-dimensional hypervectors.
Instead of relational tables, our EDB consists of 'Pentads' (Subj, Pred, Obj, Context, Lineage) bound together using prime-number circular bit-shifts to encode grammatical roles.
These facts are superposed into an 8-bit probabilistic accumulator.
For the IDB and schema enforcement, we use a 'Warden' actor in Gleam that intercepts state changes in the Tuplespace, validating them against constraints before they ever cross the C-ABI boundary.
When we query the Datalog, there are no B-trees or graph traversals.
We construct a 16k-bit probe and use AVX-512 SIMD to perform Maximum Likelihood Decoding directly against the superposed noise in O(1).
Because standard Datalog struggles with time, we extended the semantics to support LTL+ (Next, Eventually, Always, Until) natively over the vector space.
Our Episodic memory isn't a flat table; it's a strict chronological linked-list of physical accumulators stitched together with Holographic Pointers.
To evaluate temporal modalities like Eventually (◊) or Until (U), we don't use expensive SQL window functions or graph traversals.
The Zig sidecar just follows the Holographic Pointers, performing a O(1) SIMD resonance check at each temporal node.
If the target state resonates out of the noise at, say, Node 5, the LTL query resolves to true.
We execute temporal logic as a recursive physical jump through a non-Euclidean probability space.
Working next week on encoding Agent text into vectors directly without an LLM or SLM to assist.
I hope that helps!
IMO the value here will be quasi brain-like operations on data that are fast and efficient.
We overuse LLMs which aren’t too fast and very inefficient.
So the value here is being able to support a shift of some workloads from LLM to smart agentic memory.
Lenin wrote like someone who hates liberalism. Stephen Miller gives that vibe from the right, though I doubt he can write anything coherent at all.
See https://www.w3.org/2001/sw/sweo/public/UseCases/Nasa/ for a public case study.
This work led to Stardog.
Which is used extensively in NASA today—
https://gpdisonline.com/wp-content/uploads/2019/09/StardogNA...
https://www.informationweek.com/machine-learning-ai/stardog-...
Voicebox is available in Stardog Cloud or in an on-prem option via Stardog Karaoke, an appliance powered by Supermicro, Nvidia, Kubernetes.
GenAI makes appliances sexy again!
Antithesis makes them less hard (not in line an NP hard sense but still!).
Antithesis is great; has saved us a few times; and the time is great, true rock stars and great people.
Very happy customers.
https://newsroom.accenture.com/news/accenture-invests-in-sta...
Stardog, enterprise knowledge graph platform, (stardog.com), is an early adopter of Antithesis and we've found it to be very helpful in HA Cluster, distributed consensus, etc.
Not a stakeholder, just a satisfied early adopter.
If you can, find a good CBT therapist who specializes in OCD. Makes a huge difference to have expert help.