Is that a claim they've made or has that been externally proven?
What do they do instead? Given we're not talking to a base model.
Supposedly they use "RLAIF", but honestly given that the first step is to "generate responses... using a helpful-only AI assistant" it kinda sounds like RLHF with more steps.