His intro to RL (not for LLM) blog post is a great read FYI

https://karpathy.github.io/2016/05/31/rl/