Comment by osivertsson | Hacker News Reader

Top New Best Ask Show Jobs

Comment by osivertsson | Hacker News Reader

For some use-cases the Hetzner server-auction is also great value and I’ve had good experience with them.

https://www.hetzner.com/sb

For example, I was running some experiments that required lots of RAM. Right now you can get a server with 256GB RAM for €60/month.

The main draw of the auctions for me is that there is no initial setup fee, which makes experimenting a lot cheaper.

Oh wow, this could come in handy

Yep, I got 128gb ram and 2x 1tb samsung nvme for 40 a month.

That is handy to run llama.cpp https://github.com/ggerganov/llama.cpp

https://til.simonwillison.net/llms/llama-7b-m2

Reply on news.ycombinator.com