What people are missing here is that you can setup feedback loops of models to get the "correct" content or whatever you want.

For example, If you get too much NSFW content put a NSFW detection step on top of GTP ("Is this response offensive") and have that model respond to GTP with "please repeat but with fewer bad words".

For accuracy you can add a Wikipedia feedback loop. "Does this response match information on Wikipedia?" if NO ask it to try again.

Think of these models as transistors or basic logic gates. The real power comes out when you link them together into more advanced logic like a Instruction Pipeline circut.