please say what you tested, so that we can understand your effort without necessarily generalizing your conclusions beyond what you actually tried
I uploaded a text + translation into English on Sunday, and it's almost perfectly replicated the translation. 0 Google results.
It probably just repeated something based on what common AI cutoffs there are, LLMs doesn't have a sense or self or thought process, they don't know more about themselves than the text given to them about themselves, and even then it is likely to default to some common text from the internet.
If you really think it is just saying whatever it read on the web, how do you explain that not all LLM chatbots claim to be ChatGPT?
Engineering is happening, it's not just a raw model of text from the web connected directly to the user.