You'd have to ask Anthropic or OpenAI, but I've seen probably more than a dozen reports of it happening. You also risk getting your account banned for discussing certain risky things in chemistry, biochemistry, weapons, conflict, terrorism/history of guerilla warfare.

I imagine that within Anthropic and OpenAI there is a huge data set of "big no no!" topics that they maintain and continually add to. For alignment training and for more blunt purposes. For instance ChatGPT 3.5 could be instructed, as satire, to write a press release in the style of the English language propganda arm of ISIS but they put a stop to that fairly quick.