Hacker News Reader

I run KimiK2 at home, Most of it on system ram with a few layers offloaded to old 3090s. This is a cheap budget build.

Kimi-K2-Thinking-UD-Q3_K_XL-00001-of-00010.gguf Generation - 5,231 tokens 604.63s 8.65 tokens/s

Could I trouble you for the specifics of your build? I'd love to see if it would be a viable upgrade for me.

I currently have a 3970x with a bunch of 3090s.

4 3090s, epyc MB with 8 channel memory, 7352 cpu, slow 2400mhz ddr4 rams.