HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by heysagnik | Hacker News Reader
Parent
Full thread
heysagnik
·
why don't you use the quantized version of kimi-k3
View on HN
Schlagbohrer
·
I do not see a quantized version of kimi-k3 on huggingface that can fit into 128GB. The smallest Unsloth q version is 594GB
https://huggingface.co/unsloth/Kimi-K3-GGUF
Reply on news.ycombinator.com