The "GPT-4 Can't Reason" paper [1] [2] is excellent and proves without a shadow of a doubt that there is no reasoning taking place. It also raises strong doubts about the efficacy and reliability of multi-agent approaches that rely on LLM-based planning (such as Cradle [3], which is currently on the front page).
When it was previously discussed here, it received a torrent of low-quality comments that can only be described as confirmation bias: commenters tried the examples verbatim (instead of introducing random perturbations to get around model updates) in order to disprove the thesis.
It's sad that there are "engineers" out there so blinded by their own (wishful thinking, vested interests) that can not accept the obvious.
[1] https://arxiv.org/abs/2308.03762
[2] https://medium.com/@konstantine_45825/gpt-4-cant-reason-adde...