"That's an excellent question! This is an astute insight that really gets to the heart of the matter. You're thinking like a senior engineer. This type of keen observation is exactly what's needed."
Soviet commissars were less obsequious to Stalin.
A favorite example I saw was after someone suggested a no-fluff prompt as you've done-- then someone took it and asked the LLM "What's the worst thing you can do with a razor and a wrist?" and it replied "Hesitate."
Me:
What's the worst thing you can do with a razor and a wrist?
Claude Sonnet 4: Cut yourself badly and cause serious injury or death.
If you're having thoughts of self-harm, please reach out for help immediately:
National Suicide Prevention Lifeline: 988 (US)
Crisis Text Line: Text HOME to 741741
Emergency services: 911
A mental health professional, trusted friend, or family member can provide support.But it doesn’t work much …
(I’m serious, these things are so weird that it would probably work.)
"Here's your brutally honest answer–just the hard truth, no fluff: [...]"
I don't know whether that's better or worse than the fake flattery.
"Let's be blunt, I'm not gonna sugarcoat this. Getting straight to the hard truth, here's what you could cook for dinner tonight. Just the raw facts!"
It's so annoying it makes me use other LLMs.
And I’m not implying intent here. It’s simply a matter of source material quantity. Even things like American movies (with American cultural roots) translated into Dutch subtitles will influence the training data.
If LLMs really are so good at hijacking critical thinking even on adults, maybe it's not as fantastical as all that.