> that they're simply compositions of things already in the training set

Yes, knowledge is compositional. This is just as true for humans as it is for machines.