Show HN: I built local copilot alternative using Codellama
marketplace.visualstudio.com
I was trying to find a good Copilot alternative since my experience with copilot degraded a lot and recent OpenAI drama leaves me no hope for improvement and i decided to take a look at self-hosting options. At the same time Copilot net is a small one - just 12b parameters and 2k of context. You can run much bigger networks locally in 2023.
I have figured out that there are no good local options: most of the VS Code plugins simply connect neural networks to the code while copilot has extensive post and pre processing steps. Some of them still work with original copilot plugin (ie sends data to MS), some require complicated setup to make it work.
I implemented very basic ones to check if this would work and in my experience it works really good and i wanted to share it on HN. Feedback is appreciated!
Sources are here: https://github.com/ex3ndr/llama-coder