Everything about Distributed Training and Efficient Finetuning

This is an up to date discussion of useful techniques for training large models.