Hacker News Reader

Is there a guide to running these models locally? Sonnet level inference on my own hardware would be world changing.

I have Claude but I don't want to ask it because Anthropic could decide to sabotage me.

They won't be giving this away, at least not for some years. It almost certainly has distillation data embedded in it, and that would be a smoking gun.

What? I just searched the web and the results say MiMo V2.5 Pro is fully open source. The weights seem to be out there.

Distillation is not a problem.

There are certainly open weights which are available, I don't know if that is what is running on the service.

I mean you can if you have the compute. They’re all open source

Reply on news.ycombinator.com