Hacker News Reader

I think you are an optimist here. I can barely run mixtral-8x-7B on my M2 Pro 32G Mac, but I am grateful to be able to run it at all.

Which quantization level are you using?

Q2, so not so great. I usually run other models. I would be embarrassed to tell you how long my “ollama list” is.