I've been waiting for this ever since they trained BLOOM and even GPT Neo. Without instruction tuning they are almost worthless. If all you want is classification then it's better to use BERT, but if you need the generative part then you have to scale up to these big guys.

What I need is the instruction following skills of GPT-3, running on a single (large) GPU, and not having to pay by token.