I think the question is if the "rules" however captured can express reasoning.
My position is that it is not possible.
My position is that it is not possible.
Its reasoning does however have certain "bugs" that a humans reasoning would never have.
My guess is that much of those bugs appear cause the reasoning that a LLM does is not itself built on a self stabilised system. In humans you get coupling between levels of self stability which acts as a constraint, stabilising the system even more. The next level being predictive coding modelling the world. There is no next level in a LLM; they are trained as refiners in teacher forcing mode, a paradigm where self stabilisation is not a driving factor.
Seems so to me.
So explain then what you mean by "not possible".
So what about reasoning is not computable in your mind?