I'd really like to hear from the Phind team about this. Using someone else's work without attribution isn't cool (assuming this thread is true).
------
[1] In fact, I put out a set of instructions on how to get it to work with VS Code (with the help of Continue + llama.cpp) a couple of days ago: https://news.ycombinator.com/item?id=37296728
I don't get any attribution for the code or messages I wrote that GPT4 was trained on, and there are multiple examples of LLMs regurgitating people's code (even copyrighted code) without attribution.
The training dataset is just upstream of the fine-tuning step but both are supplying vital data to the whole pipeline.
Still rude though. Rude on rude.
Point being, there’s a legit conversation to be had about AI training data, but it’s not the same conversation as humans intentionally creating a derivative work. I think it’s too reductive to insist those are the same thing.
I fail to see how anyone with your viewpoint isn’t flat out being intellectually dishonest. It is understood that it is both (usually) legal and ethical to not attribute someone when they teach someone an abstract skill set which they use to develop something “new”. LLMs inarguably bring us closer to reaching that point without implicating human effort in the creation process. “You did it with a computer, so copyright!”is such a naive and frankly wasteful take as it threatens to forego massive societal advances in favour of intellectual property rights. What sort of society is that!? An overly American one, that’s for sure.
This isn't a student learning from a teacher, its a student copy-and-pasting an answer they found. It isn't learning an abstract skill set which it is using to develop something new, its literally just copying the code.
It is utterly dishonest to make the comparison you do in your comment.
My fundamental programming skills are solid (30+ years programming!), but I only started using Python extensively relatively recently. I can get the language to do what I want it to do—but often not in the most "Pythonic" way. With CodeLlama, I'm able to check if I've done things in the "right" way, and I'm also able to ask questions when I'm trying to figure out how to implement something.
As mentioned above, I cannot use GPT-4 for my startup, but I have used it for personal stuff. My feel so far is that wizardcoder-python-34b is surprisingly good. I certainly haven't thought "oh, I wish I had GPT-4 instead"—at least, not yet! (I haven't used Copilot either, for the same reasons listed above.)
--------
[1] Shameless plug: https://www.amw.ai