Hacker News Reader

github has a bunch of them for years, the most known from Andrej Karpathy:

some other have MoE implemented.

Personal fave: https://github.com/karpathy/llama2.c

nanoGPT is awesome (and I highly recommend his videos on it), but it’s closer to a direct reproduction of GPT-2, so it’s cool to have a really clean implementation of some newer ideas.

nanoGPT contains some new ideas. https://github.com/karpathy/minGPT is more plain

Reply on news.ycombinator.com