This is known. The HF in RLHF upon which InstructGPT is fine-tuned is human feedback. With so many people offering their take on this new technology, perhaps it's important to at least read a little before writing about it.
The main question holds, still: will the human IQ limit the capabilities of GPT and other models?
Unless the models of a way of assessing output quality independent of, superior to, and which trumps input provided by humans, yes.