HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by adastra22 | Hacker News Reader
Parent
Full thread
adastra22
·
What’s the best open source alternative?
View on HN
jckahn
·
Jan:
https://www.jan.ai/
PeterStuer
·
LibreChat with vLLM?
https://www.librechat.ai/docs/configuration/librechat_yaml/a...
khimaros
·
llama.cpp
atwrk
·
To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.
Reply on news.ycombinator.com