"a word that does not exist; it was invented, defined and used by a machine learning algorithm."

I've minimal understanding of AI/ML but from what I think I know, isn't it all based on probability and therefore the quote above that these words don't exist is.. possibly wrong?