OpenAI trained the initial 1.5B model on ~160G of text.. so I’m sure it’s already going to give amazing results.