Hacker News Reader

I don't know, maybe I'm desensitized by GPT4 but I'm running Llama2 70B and I certainly wouldn't call it 'disturbingly good'.

View on HN

Base Llama is not good at all, but the finetunes are quite good at their niches.

Llama in general is not great for code completion and fact retrieval, from what I have tried

Check out the hugging face leader board and try one of the finetunes.

I can't run llama2 70B - but I remember llama1-Guanaco30B was a major leap over the base llama30B model for me.

Thanks! That's useful to know. Unfortunately it looks like a lot of them are non-commercial which rules them out for me but there's a couple that look like they might work.

Its rather outdated. Search for "70b" on huggingface, sort by date, and you will find more cutting edge models.

And you can run this locally with enough combined RAM + VRAM.

Reply on news.ycombinator.com