We do represent much of our cognition in language.
Sometime I feel like LLMs might be “dancing skeletons” - pulleys & wire giving motion to the bones of cognition.
https://en.wikipedia.org/wiki/Philosophical_zombie
Editor's note: I do not promote such a worldview -- my intention is precisely the opposite.