Which bolsters the claim that it doesn't really understand what it's generating in a way humans understand language. Sure, it can be said to have a kind of understand for the rules of language it's been trained successfully on, but when you get it in a weird place, that understanding breaks down in a way it doesn't for people.