This is interesting with the recent work showing that models using different architectures, but the same dataset converge to similar capabilities. It makes the case that the data set itself and the compute over it is the secret sauce for these models.

It'll be especially interesting with the ruling indicating that the output of these models isn't copyrightable as that and internally generated (from scratch) data will be the only bits omitted from this reporting. I'll be curious if the gap gets bridged on including the disclosure of data generated by a model containing copyrighted data.