> Also, the average consumer is not going to be running a local model until they are built into the hardware they already buy and when they are, who is supplying the weights?
Why not? Apple would have you download an updated set of weights with OSX / iOS updates. Nvidia could bundle them with driver updates. I don't think either would struggle to get people to keep their weights up to date.
I’m sure it would be fine for simple routine tasks but it wouldn’t compete with OpenAI and Anthropic models
Maybe, but that you’ll have to take up with the author of the article.