HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by Tepix | Hacker News Reader
Full thread
Tepix
·
Always put the quantisation in the title!
View on HN
pich
·
Its not quite that simple here. The iMatrix-guided hybrid uses different quantization levels per tensor/layer, so there isnt one honest Q4/Q5/NVFP4 label I can put in the title
Reply on news.ycombinator.com