Anyone who's done any kind of substantial document research knows that it's a NIGHTMARE of chasing loose ends & citogenesis.
Trusting an LLM to critically evaluate every source and to be deeply suspect of any unproven claim is a ridiculous thing to do. These are not hard reasoning systems, they are probabilistic language models.
This is like arguing an Airbus cannot possibly fly because it is 165 tonnes of aluminum, steel and plastic.
The proof is in the fact that it flies, not what it is constructed from.
And LLMs do not.
> "But it looks like reasoning to me"
My condolences. You should go see a doctor about your inability to count the number of 'R's in a word.
CoT reasoning is reasoning, whether you like it or not. If you don't understand that, it means the models are already smarter than you.