Hacker News Reader

Not OP but I am finding the Qwen 2.5 32b distilled with DeepSeek R1 model to be a good speed/smartness ratio on the M4 Pro Mac Mini.

I'm running the same exact models.

How much RAM?

It takes between 22GB-37GB depending on the context size etc. from what I've observed.

Thanks!