Hacker News Reader

Comment by v3ss0n | Hacker News Reader

Why ollama, why not llamacpp? The real effort is done by llamacpp, ollama is unnecessary layer on top of it and cashing in investor money.

This behavior is totally unacceptable and I am boycotting ollama and every ollama based stuff. I am not going to use ollama in my client projects anymore too.

View on HN

What's funny is that ollama just runs the llama.cpp example http server on a random port under the hood and proxies requests to it, it doesn't even link against llama.cpp

Yeah they intrusively listen on a port. It is security redflag.

Yep, and the only acknowledgement to llama.cpp is that llama.cpp is a "supported backend" (see last page of their GitHub repo readme)

And the acknowledgement was only added after community outcry. If not for that they would have kept on as if llama.cpp didn't exist.

Implying ollama has other back ends which it does not.

The Genkit framework just launched and it has open plugin API. You can already find support for groq, openai, anthropic... I don't think the answer to your question ("Why ollama, why not llamacpp?") really matters (maybe only out of curiosity), but practically if you want llamacpp support someone will probably add it very shortly... It's open-source.

Waiting until ollama announces that they are raising money through VCs.

Just like Keybase, Bitwarden, Element, ggml also did.

We as a community need to rise up awareness that llamacpp can be used as easily as ollama. Another thing is ollama models are hosted on non-open infra service.

Reply on news.ycombinator.com