HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by wkat4242 | Hacker News Reader
Parent
Full thread
wkat4242
·
I wonder, can you quantize it yourself with some tool?
View on HN
pja
·
llama.cpp can quantize a model for you:
https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#qu...
wkat4242
·
Thanks!!
Reply on news.ycombinator.com