Not OP, but I ran 122b successfully with normal RAM offloading. You dont need all that much VRAM, which is super expensive. I used 96gb ram + 16gb vram gpu. But it's not very fast in that setup, maybe 15 token per second. Still, you can give it a task and come back later and its done. (Disclaimer: I build that PC before stuff got expensive)
128GB on a mac with unified memory. The model itself takes something like 110 of that and then I have ~16 left over to hold a reasonably sized context and 2 for the OS.
I do have a dedicated machine for it though because I can't run an IDE at the same time as that model.
I squeeze Qwen3.5-122B-A10B at Q6 into 128GB. It's a great model.
Wow what kind of hardware do you have? Mac Studio, dgx spark, strix halo? How fast is it?
Strix Halo, I'm seeing performance inline with these results[0].
I'm interested to investigate the claimed gains from the lemonade-sdk port of Apple MLX inference[1].