Over 1k tok/s on an RTX 5090 with Qwen3 0.6B

blog.alpindale.net

2 pointsAlpinDale1 comment

GitHub seems to be down right now, but the kernel is here: https://github.com/AlpinDale/qwen_megakernel (1,008 tok/s now, a bit improved after I made the blogpost)