We show you how to fine-tune code LLMs on custom code corpuses covering various objectives such as infilling, QnA, etc. We provide details on data collection, parameter-efficient fine-tuning, and more. Finally, we show you how to build a VSCode Extension for your fine-tuned code LLM.