OpenAI, Microsoft sued for copyright infringement in class-action lawsuit

>OpenAI doesn’t disclose what data it used to train GPT-4, its most advanced large language model, but lawyers for Sancton say ChatGPT divulged the secret. “In the early days after its release, however, ChatGPT, in response to an inquiry, confirmed: “Yes, Julian Sancton’s book ‘Madhouse at the End of the Earth’ is included in my training data,” the lawsuit reads.

This is evidence of absolutely nothing as GPT cannot reflect over what is or is not in it’s training set. I’m shocked this is reported uncritically - here the impartiality of ‘just the facts’ distorts more than it enlightens.

Authors need to come up with the literary equivalent of “trap streets”.

I can’t help but think the “proprietary” secret nature of the training data is just an attempt to sidestep the copyright issue. Like the “national security secret” line that the US government likes to use.

Crap training data = crap model.

Only licensed training data = base model not as good as open models.

Stolen training data plus RLHF to suppress this fact = great model!