Should we be changing our open source licenses to explicitly prevent training such systems using our code?
What is confusing is that the neural net may take lots of small chunks and link them to one another, and then reproduce them in the same order verbatim.
So, the length of the samples being drawn is not necessarily small: the chunk size is based on its commonality. It could easily be long enough to trigger a copyright violation.
Licenses hold no power outside of that granted to it by things being copyrighted by default.
The code that is already used to train should be problematic for them, not only new Code in the future.
At least as long as the system really learns concepts. If it just copy & pastes code, then that's a different story (same as with humans).