It's sort of frustrating to know that OpenAI has a better model that wouldn't cost them anything to release, but they don't do it for PR/whatever reasons.
What “better model”? If you’re referring to whatever LLM GPT-4 was before RLHF, by what measure might this model be better? As I pointed out above, what OpenAI is selling is “best” for their customers.