That line of thought would get thrown out of court faster than an AI would generate it.
That line of thought would get thrown out of court faster than an AI would generate it.
Me teaching my brain someone’s way of syntactically expressing procedures is analogous to AI developers teaching their model that same mode of expression.
If I can't feed a news article into a classifier to teach it to learn whether or not that I would like that article that's not a world I want to live in. And yes it's exactly the same thing as what you are accusing LLMs of.
They should be subject to laws the same way humans are. If they substantially reproduce code they had access to then it's a copyright violation. Just like it would be for a human doing the same. But highly derived code is not "stolen" code, neither for AI nor for humans.
To me, the argument is a LLM learning from GPL stuff == creating a derivative of the GPL code, just "compressed" within the LLM. The LLM then goes on to create more derivatives, or it's being distributed (with the embedded GPL code).
The AI companies don't care much about this. When the time comes, they will open their models or stop using sources that don't meet the appropriate licensing. Their current concern is learning how to build the best models, and win the race to become the dominant AI provider - who cares if they need to use polluted sources to reach their goal. They will fix it later.