Related: LLMs trained on "A is B" fail to learn "B is A"

https://arxiv.org/abs/2309.12288