Hacker News Reader

Why is it necessary to sign up for two external services if this is running the LLM locally?

(I've gotten this working, more or less, but don't have the hardware to make it practical so I can't give any feedback about Continue or the model.)

Amazing. Was looking for instructions to do precisely that

No need to sign up for any service to use Continue with Ollama. This will do the inference all locally.

I believe if you want to do the inference using Replicate or Together, you’ll have to sign up for their services.

I don't have a Mac.

So it's either have a Mac or don't run locally if you want to use this service?

Sorry about that. We are working on building the Windows and Linux versions. May I ask which specific OS you are on?

Not OP, but would be great to have it working on Linux. How can one help?

^exactly, Replicate or Together are only options that are potentially more convenient