Load a large language model in 4bit and train it using Google Colab and PEFT

From the Huggingface blog post: Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA (https://huggingface.co/blog/4bit-transformers-bitsandbytes)