DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-Like Models

github.com

3 pointsashvardanian1 comment

An order of magnitude speedup for GPT-like models? Not sure why this story isn't bigger news..