I am surprised nobody links this blog post demonstrating that the paper's conclusion is not true (even for gpt3.5): https://andrewmayne.com/2023/11/14/is-the-reversal-curse-rea...

It seems like restrictions on the model talking about non famous people might have been responsible for the appearance of the models being unable to do this.