Hacker News Reader

Sorry for the tangent, but how does Qwen3.8-flash-next compare to DeepSeek v4 Flash? I still haven't found the time to set it up, but I'm really happy with DeepSeek v4 Flash

View on HN

It was the best model given my constraints (RTX PRO 6000 96gb + 256GB DDR4), when run against rust programming benchmarks. For Qwen3.8-flash-next NVFP4 and the latest vllm container, the PLE is 100GB of main ram, and everything else runs on the GPU with room for a total of 560k tokens (two full 262k conversations). DeepSeek has to offload a ton to the CPU and it performed worse than Qwen in absolute terms and was a lot slower (not usable).

If you have enough room to run DeepSeek v4 Flash comfortably then you can likely run the Q8 of the qwen model.

Reply on news.ycombinator.com