Hacker News Reader

Oh I thought this was a quick guide to host it on any server (AWS / other clouds) of our choosing.

I had the same question initially, was a bit confused by the Umbrel reference at the top, but there's a section right below it titled "Install LlamaGPT anywhere else" which I think should work on any machine.

As an aside, UmbrelOS actually seems like a cool concept by itself btw, good to see these "self hosted cloud" projects coming together in a unified UI, I may investigate this more at some point.

Yes! It can run on any home server or cloud server.

Interesting. I might try to get this to work on my NAS.

Good luck! The token/sec will be under your expectations or it will overheat. You really shouldn't play games with your data-storage. You could try it with an old laptop to see how bad it performs. Ruining your NAS for this is a bit over the top to show, that "it worked somehow". But i don't know, maybe your NAS has a powerful processor and is tuned to the max and you have redundancy and don't care to loose a NAS? Or this was just a joke and i fell for it! ;)

Not sure how powerful their NAS is, but on Umbrel Home (which has an N5105 CPU), it's pretty useable with ~3 tokens generated per second.

Reply on news.ycombinator.com