These articles are way more hype than substance. The review process is barely sufficient to even give credit for the AI to actually have come up with the language, not that its training data was contaminated in some way.

Better to wait for a thorough review on GPT-4's zero shot abilities from an academic paper.