Writing an LLM from scratch, part 32i – Interventions: what is in the noise?gilesthomas.com·1 pts·gpjt·0
Writing an LLM from scratch, part 32d – Interventions: adding attention biasgilesthomas.com·6 pts·gpjt·0
Writing an LLM from scratch, part 32a – Interventions: training a baseline modelgilesthomas.com·1 pts·gpjt·0
Writing an LLM from scratch, part 31 – the models are now on Hugging Facegilesthomas.com·2 pts·gpjt·0
Writing an LLM from scratch, part 30 – digging into the LLM-as-a-judge resultsgilesthomas.com·1 pts·gpjt·0
LLM from scratch, part 28 – training a base model from scratch on an RTX 3090gilesthomas.com·540 pts·gpjt·121
Revisiting Karpathy's 'Unreasonable Effectiveness of Recurrent Neural Networks'gilesthomas.com·2 pts·gpjt·0
Writing an LLM from scratch, part 20 – starting training, and cross entropy lossgilesthomas.com·41 pts·gpjt·3