I thought generating text is the only way for GenAI/LLM models to "think".
How exactly does ChatGPT "quietly think"?
Is there text generation happening in layers where some of the generated text is filtered out / reprocessed and fed back into another layer of text generation model before a final output is shown to the user as a respose on UI? So a "thinking" layer separate from a "speaking" layer?
But there is an association in there somewhere that “zebras are animals that have stripes” that isn’t necessarily linking those words (it could be linking the concepts of zebras, stripes and animals).
It doesn't quietly think, this just primes the model to respond in a way that is more likely to follow the phrase "Before answering, quietly think about whether".
These two things make it extremely special. Probably the most special thing on earth.
Regardless, we're talking about cognitive thinking and decision making, not consciousness. The two are not dependant on each other.
sounds simple as well as deep at the same time if that's how it works.
I also wonder if there is a way for instructions to dynamically alter settings like temperature and verbosity.
for example when generating syntactic output like json or code ...don't be too creative with syntax at line level but at conceptual or approach level, go ahead and be wild.