HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by synaesthesisx | Hacker News Reader
Full thread
synaesthesisx
·
How this compare to just running llama.cpp locally?
View on HN
mayankchhabra
·
It's an entire app (with a chatbot UI) that takes away the technical legwork to run the model locally. It's a simple one line `docker compose up -d` on any machine, or one click install on umbrelOS home servers.
Reply on news.ycombinator.com