Comment by nialv7 | Hacker News Reader

Top New Best Ask Show Jobs

Comment by nialv7 | Hacker News Reader

Parent Full thread

ISTA-DASLab's IQ3_S quant is really good https://huggingface.co/ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RC...

What are you running it on? I'm getting mixed results using the IQ3_XXS quant which supposedly matches baseline, it feels significantly degraded.

Reply on news.ycombinator.com