To reconcile this statement with his admission that ChatGPT reliably turns out passable results, we must assume the average student simply rearranges word patterns as well. So developmentally, this must be a mile marker on the road to competence.
"[Writing] is an embodied process that connects me to my own humanity, by putting me in touch with my mind"
ChatGPT's experiences with its own "mind" are fleeting and lost forever with each reset of prompt and zeroing of prompt history. Prompt compression and embedding architectures, combined with the steady growth of hardware memory capacity, should allow new models that continuously generate and process "thought" prompts. This should allow the primitive emergence of self-narratives and make a leap, I feel, towards the generation of true meaning.