I could theoretically do the same math on a piece of paper to generate a list of tokens, then decode all the tokens into a sentence and read the sentence I generated for the first time at the very end of the process.

In this process, where was the intelligence? It didn't come from me. I didn't know what sentence I was generating until I was able to read it at the end. Was it in the pencil? The paper?