Hacker News Reader

What hardware do you run Qwen 3.8 Flash Next on?

I also run Qwen3.8 Flash Next "locally at home", on a Framework Desktop, so Strix Halo and 128GB... we're not talking laptops, exactly, if that's what you wanted to know.

Still, the halogen version only occupies < 40GB RAM on my machine (which is surprising... the Q4 takes over 100GB), so perhaps a 64GB version is on the table.

A DGX Spark-like, the Asus GX10. I’m kicking myself that I didn’t buy a second one when I thought about it months ago, but Nvidia’s NVFP4 quantisation of Flash Next and offloading the ngram table to NVMe has worked well

I run Qwen3.8 Flash Next on 2x Sparks at $WORK and it has been great! It can run 16 concurrent sessions with decent speed (~30-40 t/s per session) and can hold 8 full 256k contexts in cache. It has turned out to be a great production setup for our company.

I have a half finished repo that sets it all up for production (using systemd, not hacky scripts and one-off docker commands), if someone is interested in this, tell me, and it might give me the push to actually finish up the latest threads and publish it!

Reply on news.ycombinator.com