Hacker News Reader

Similarly, is there any half decent general LLM that can run on consumer hardware?

Thinking to add LLaMA or other OSS LLM models soon

Please consider LLaMA.cpp (https://github.com/ggerganov/llama.cpp), which supports a lot of models and doesn't need an expensive GPU.