https://jaykmody.com/blog/gpt-from-scratch/ for a gpt2 inference engine in numpy
then
https://www.dipkumar.dev/becoming-the-unbeatable/posts/gpt-k... for adding a kv cache implementation
then
https://www.dipkumar.dev/becoming-the-unbeatable/posts/gpt-k... for adding a kv cache implementation