Hacker News Reader

Comment by regularfry | Hacker News Reader

I would very much like a local code assist tool. Assuming integration with editors is my problem, what's best in class this week if a) I have a respectable GPU; b) I don't, and need CPU-only?

View on HN

On Visual Studio there's an extension (by Microsoft) called IntelliCode which is a small AI assistant that runs locally on the CPU. It doesn't come close to these new large GPU models but it's quite handy. It looks into what you're typing on the current line and the previous activity along with the current project and tries to predict the full line or even the same change on multiple lines if that makes sense.

We recently published a paper on IntelliCode and share some of the usage numbers.

https://austinhenley.com/pubs/Vaithilingam2023ICSE_IntelliCo...

Disclaimer: I'm one of the co-authors.

Check out https://github.com/TabbyML/tabby, which is fully self-hostable and comes with niche features.

On M1/M2, it offers a convenient single binary deployment, thanks to Rust. You can find the latest release at https://github.com/TabbyML/tabby/releases/tag/latest

(Disclaimer: I am the author)

I have just installed Fauxpilot <https://github.com/fauxpilot/fauxpilot> (nVidia GPU-only) and it works... OK. Still evaluating and I'm basically sceptic on the whole concept, but... let's see.

Nothing even comes close to copilot. I realise you said “local”, but if you insist on that you’re going to be disappointed.

Reply on news.ycombinator.com