Can LLMs Every Reason?

If they could really reason, all you would need to do is teach them language and expose them to it and they would figure the rest out on their own.

Instead, what they exhibit is something less --- call it statistical mimicry.

I think it is highly likely that exposing LLMs to the internet will make them noticeably dumber over time instead of smarter. They'll start consuming their own inaccurate BS and accepting it as fact in a self polluting and destructive feedback loop.