(2019)
Note that this article precedes both ChatGPT and GPT-3. When it was written, Leibniz' idea of a machine reasoning by manipulating symbols was still science fiction. Now it is very much reality.
Note that this article precedes both ChatGPT and GPT-3. When it was written, Leibniz' idea of a machine reasoning by manipulating symbols was still science fiction. Now it is very much reality.
"War and Peace"
as a string of ISO-Latin1 characters which are frequently found in that order, and "novel by Tolstoy which contains many insights into the human condition" _and_ understanding the symbolism of said insights.
A grade school student who has read and understood _War and Peace_ would be able to write a paper which is original to the degree that it did not previously exist as that exact sequence of characters, even if it had no original insights, while ChatGPT would regurgitate the most frequent combinations of characters which the metadata and so forth indicate are in the context of writing about that novel.
(Large language models are not plain Markov chains, contrary to popular belief)
Maybe it’s all information and symbols are a small way to grasp at it but not the complete way.