> What is instinct physically?

Does it matter? As long as it conceptually exist that’s all that matters.

LLMs don’t seek any goal. It’s advanced autocomplete.

You can’t give it a bunch of facts and a goal then expect it to figure out how to achieve said goal. It can give you an answer if it already has it (or something similar) in its training set - in the latter case, it’s like a student who didn’t study for the exam and tries to guess the right answer with “heuristics”.

> A LLM also can't do multi-step reasoning, yet here we are.

Where’s “here”?