Ai2 OLMoE: an on-device open-source model

I love AI2’s work. They are the one actually open AI team, since they publish everything - their training data sets, the training source code, the weights, all of it. You could reproduce their model from scratch if you wanted.

I tried the app they published today that does on-device AI. It’s not bad but its inference is definitely slower than using a paid service like ChatGPT. Maybe future chipsets will make this a lot better and lead to privacy first AI apps.