Hacker News Reader

Agree. Please provide more details on this setup or a link.

Just try a few models on your machine? It takes seconds plus however long it takes to download the model.

I would prefer to have some personal recommendations - I've had some success with Llama3.1-8B/8bits and Llama3.1-70B/1bit, but this is a fast moving field, so I think it's worth the details.

New LLM Prompt:

Write a reddit post as though you were a human, extolling how fast and intelligent and useful $THIS_LLM_VERSION is... Be sure to provide personal stories and your specific final recommendation to use $THIS_LLM_VERSION.

Reply on news.ycombinator.com