"The more adept LLMs become at mimicking human language, the more vulnerable we become to anthropomorphism, to seeing the systems in which they are embedded as more human-like than they really are. This trend is amplified by the natural tendency to use philosophically loaded terms, such as "knows", "believes", and "thinks", when describing these systems."
--
An ignorant statement / question I have is why are you using it write code? It's a chatbot, no?
As you've mentioned, it's a really powerful search, and is like having a conversation with someone who is literally the internet.
For example "What is the glycemic index of oatmeal?"
"What is Eihei Dogen's opinion of the Self and how does it differ from Bassui's?"
I get highly detailed and accurate output with these.
The first question is simple and the second is far from it. It's breaking down two Zen masters experiences and comparing them in an amazing way.
I've been thoroughly impressed with Chat GPT so far.
Ask it to breakdown the high level points of a book you've read.
Ask it to rewrite a song in the style of a different artist.
It's so cool, I feel like I legitimately have an answer to any random question at my finger tips and have to do zero filtering for it.