Foundations of Large Language Models

Quite good to understand the theory behind LLMs. Latest version always seems to be at arxiv.

Also read the excellent Introduction to Large Language Models by Tanmoy Chakraborty - https://tanmoychak.com/llmbook/