Zine on LLM Evals

We’re writing and illustrating a digital zine on building LLM evals. It’s set in a world where forest creatures learn how to prompt the LLM shoggoth living in the canopy of their home.

We wrote this zine for AI engineers that have heard of evals, but don’t know where to get started building their own evals.

The inspiration from the meme that LLMs are an alien intelligence that we put a mask on to make it palatable for us. Juxtaposing it against forest animals seemed amusing, and a way for us to do some world-building and fun as well.

In case you miss it on the landing page, here are some sample pages and table of contents (subject to minor changes). https://forestfriends.tech/assets/preview.pdf?v=1