Hacker News Reader

Check out the hugging face leader board and try one of the finetunes.

I can't run llama2 70B - but I remember llama1-Guanaco30B was a major leap over the base llama30B model for me.

Thanks! That's useful to know. Unfortunately it looks like a lot of them are non-commercial which rules them out for me but there's a couple that look like they might work.

Its rather outdated. Search for "70b" on huggingface, sort by date, and you will find more cutting edge models.

And you can run this locally with enough combined RAM + VRAM.

Reply on news.ycombinator.com