onetokenatatime

Fair! I really hope kids don't think any of what's happening is magic. I tried to design against it: the alien is just a next-token predictor, has no memory, and can't do anything without the robot. It's painstakingly trained by the scientists. So I was hoping to frame it as a multi-part scientific endeavour rather than magic.

I wrote a little aliens story in an attempt to explain to my children how agentic AI works under the hood. You too may find it helpful if you would like a simple mental model of how concepts such as LLMs, harnesses, SFT, RLVR, RLHF, attention, sub-agents, thinking tokens, prompt injection, and context compaction fit together.