Isn't ChatGPT overtly taught by OpenAI to be positive, friendly, and to avoid controversy?

I think there's a lot of behind the scenes manipulation of the model to steer clear of anything that would bring negative criticism of its output.

Surely that leaks into what lyrics it chooses to write, what stories it can produce.