I don't think that this related to language, at all. First, let's ask, is there a way for DALL-E to refuse an output (as in, this makes no sense). Then, what would we expect the output for gibberish to be like? Isn't this still subject to filtering for best "clarity" and best signals? While I don't think that these are collisions in the traditional sense of a hash collision, any input must produce a signal, as there is no null path, and what we see is sort of a result of "collisions" with "legitimate" paths. Still, this may tell us some about the inner structure.
Also, there is no way for vocabulary to exist on its own without grammar, as these are two sides of the phenomenon, we call language. Some signs of grammar had to emerge together with this, at once. However…
----
Edit: Let's imagine a typical movie scene. Our nondescript individual points at himself and utters "Atuk" (yes, Ringo Starr!) and then points at his counterpart in this conversation, who utters "Carl Benjamin von Richterslohe". This involves quite an elaborate system of grammar, where we already know that we're asking for a designator, that this is not the designator for the act of pointing, and that by decidedly pointing at a specific object, we'd ask for a specific designator not a general one. Then, C.B. von Richterslohe, our fearless explorer, waves his hand over the backdrop of the jungle, asking for "blittiri" in an attempt to verify that this means "bird", for which Atuk readily points out a monkey. – While only nouns have been exchanged, there's a ton of grammar in this.
And we haven't even arrived at things like, "a monkey sitting at the foot of a tree". Which is mostly about the horizontal and vertical axes of grammar, along which we align things and where we can substitute one thing for another in a specific position, which ultimately provides them with meaning (by what combinations and substitutions are legitimate ones and which are not).
Now, in light of this, that specific compounds are changing their alleged "meaning" radically, when aligned (composed), doesn't allow for high hopes for this to be language.