Hacker News Reader

Comment by EagnaIonat | Hacker News Reader

Have you tried using Ollama? You can download and run an LLM locally on your machine.

You can also pick the right model for the right need and it's free.

Yes. If the AI is not integrated with the IDE, it's not as helpful. If there were an IDE plugin that let you use a local model, perhaps that would be an option, but I haven't seen that (Github Copilot allows selecting different models, but I didn't check more carefully whether that also includes a local one, anyone knows?).

It’s doable as it’s what I use to experiment.

Ollama + CodeGPT IntelliJ plugin. It allows you to point at a local instance.

I also use Ollama for coding. I have a 32G M2 Mac, and the models I can run are very useful for coding and debugging, as well as data munging, etc. That said, sometimes I also use Claude Sonnet 3.5 and o1. (BTW, I just published an Ollama book yesterday, so I am a little biassed towards local models.)

Thanks for the book!

> (Github Copilot allows selecting different models, but I didn't check more carefully whether that also includes a local one, anyone knows?).

To my knowledge, it doesn't.

On Emacs there's gptel which integrates quiet nicely different LLM inside Emacs, including a local Ollama.

> gptel is a simple Large Language Model chat client for Emacs, with support for multiple models and backends. It works in the spirit of Emacs, available at any time and uniformly in any buffer.

https://github.com/karthink/gptel

This can use Ollama: https://www.continue.dev/

> If there were an IDE plugin that let you use a local model

TabbyML

I’m using ChatGPT4o to convert a C# project to C++. Any recommendation on what Ollama model I could use instead?

The one that does not convert C# at all and asks you to just optimize it in C# instead (and to use the appropriate build option) :D

I’m converting game logic from C# to UE5 C++. So far made great progress using ChatGPT4o and o1

Do you find these working out better for you than Claude 3.5 Sonnet? So far I've not been a fan of the ChatGPT models' output.

I find ChatGPT better with UE4/5 C++ but they are very close.

Biggest advantage is the o1 128k context. I can one shot an entire 1000 line class where normally I’d have to go function by function with 4o.

Reply on news.ycombinator.com