Analysis of LLM's Reasoning Abilities
secondsight.dev
secondsight.dev
Unless it zooms in on "Unrelated" and ignores the sentences it produces. reinforced by unrelated sentences.
I also think we shouldn't compare ChatGPT with LLMs 100%. While I'm sure ChatGPT is mostly an LLM at the very least it has a programmatic veneer for moderation. How know what is behind the curtain as far as every thing else.