I wonder how the number of parameters of this will compare to GPT-3 - will there be different sizes? Their stated goal is to make this available to academics/independent researchers/startups, and I think with a 175B parameter model, not having the trained model itself isn't necessarily the biggest hurdle for most people (having hardware with x hundred GB memory is - well maybe not for startups.)

Although there seems to be hope:

>In prior work, OpenAI found that the outputs from models trained with RLHF were preferred to those from 100x larger models trained without human feedback.