I'm not sure why training on a diverse set of words would lead to converging on one word (but maybe there's a joke going over my head :P)
https://en.wikipedia.org/wiki/Buffalo_buffalo_Buffalo_buffal...
> Thomas Tymoczko has pointed out that there is nothing special about eight "buffalos"; any sentence consisting solely of the word "buffalo" repeated any number of times is grammatically correct.
Anyone who wants to go down that rabbit hole, see https://en.wikipedia.org/wiki/List_of_linguistic_example_sen...