This is because this is the "Sexist Doctor Riddle"[1] but with one word changed.
And the probability machine is returning its training. This isn't some political correct overtraining conspiracy.
And the probability machine is returning its training. This isn't some political correct overtraining conspiracy.
There are totally some political correctness effects in LLMs. Like, the last part about "along with a small lecture about gender biases" totally tracks. But the riddle switcheroo itself isn't showing much.
LLMs are just statistics based on vibes. Switching the gender of the character in the beginning of the story, but keeping all else identical is going to be a huge signal into the noise, and that response is going to be wildly likely to occur.
I’m not saying it’s a “political conspiracy”, it’s the alignment tax.