HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by mirekrusin | Hacker News Reader
Parent
Full thread
mirekrusin
·
2x RTX 4090, Q8, 256k context, 110 t/s
View on HN
instagib
·
1 4090, Qwen3.5-35B-A3B-UD-MXFP4_MOE, 64k context, 122 t/s. Llama.cpp
mirekrusin
·
I believe it's mentioned that MXFP4 performs surprisingly bad, you may want to try other Q4s.
Reply on news.ycombinator.com