GPT Code Clippy, the Open Source Version of GitHub Copilot
github.com
github.com
It seems like this must be in fairly early stages? The HumanEval numbers in the README seem to indicate the pass rate with one sample (pass@1) on the benchmark is at best 0.06%, whereas the Codex paper reports up to 28% (for the Codex-12B model). I'm actually kind of surprised by this, since even the very small Codex models (e.g., Codex-12M) manage 2% on that benchmark.
I also don't see a lot of recent activity – anyone know if the project is still alive?
Tabnine was so compelling I posted here not long after using it that AI-based code completion was being slept on, because it was obviously so much better than what the IDE could do. [1]
I pointed out that Microsoft was uniquely positioned to offer superior code completion services due to its fire-hose access to new code on GitHub.
Interestingly, the top reply from ptx was their “hope we'll also see a strong counter-movement of simple tools for independent developers.” Which is just what Code Clippy seems to attempt.
I continue to think AI-based code completion and AI assisted code quality recommendation services will be the differentiator as so much of IDE features are commoditized.
The big missing party in my view is Apple with Xcode. Not only do I think Xcode needs it’s own local-capable AI code completion, I think Apple needs a semi-social GitHub-like repository service of its own to help feed this AI.
Why? Can't they lift code off github, gitlab, etc ? I don't remember giving Microsoft permission to use my code to train Copilot. They did it because it was public. Apple can always clone all public repos and do it themselves.
Also, there will likely be Apple service secrets stored alongside that, and Apple will want to be the ones responsible for protecting those.
For example, GitHub Actions like workflows on top of iOS projects
I just got into the preview today, and it seems like that is what it is to me.