You think there's something incorrect about this?
For god's sake I hope you aren't blind to the difference between a thought and actually raping a child.
Sure, let's say they aligned the question regarding pedophilia one way or another, but what do you do about questions about religion? Questions about ongoing wars that are full of emotional attachment? All the Twitter takes about freedom of press doesn't even make sense once you get out of US-centric view either, and then there are questions about enemy-state owned press. You can carve out so many these-type of questions that any company that are under public's eye will be scrutinized to hell for whatever answer the model produces.
What I'm getting into, big corps would probably be better off if all the models were limited for some sort of specific use cases (e.g. programming) rather than aiming for "catch-all-do-all". And if they want, they should've gone Microsoft way and invest big time into a company that's dealing with it so they can use the "it's not reaaaally us producing results that are bad for PR!".
I actually agree with this. What bothers me to some extent is how they're obfuscating instructions given to the model, its (rather extreme) biases, while presenting it as a safe, universal model.
If people want to have access to this kind of "safe" output, I don't mind, but it's my opinion that general purpose LLMs should have some semblance of neutrality in their default configuration (fully realizing that this goal is impossible to achieve with perfection) and should behave like tools that simply do what they're instructed to do, drawing from the source material without any further instructions or explicit bias.
We have accepted that people cannot control who they are attracted to, IOW sexual orientation.
You can't very well now turn around and claim that people can control who they are attracted to.
Edit: I see you have edited the comment with more content that wasn't there when I replied. I don't think this changes the validity, or lack thereof, in your outrage at the LLMs answer.
If it's logically sound, I see no problems.