It's frustrating though because these companies have the resources to do amazing things, but it's been shown that censoring an LLM can dumb it down in general, beyond what it was originally censored for.
Also, this of course. It's just a cheap bandaid to prevent the most egregious mistakes and embarrasing screenshots.
Both sides in this to me need to get a life.
Just the fact that there's a x% risk it doesn't answer complicates any use case unnecessarily.
I'd prefer if the bots weren't antrophomized at all, no more "I'm your chatbot assistant". That's also just a marketing gimmick. It's much easier to assume something is intelligent if it has a personality.
Imagine if the models weren't even framed as AI at all. What if they were framed as 'flexi-search' a modern search engine that predicts content it hasn't yet indexed.