I think a sub-set of people see this coming, I also think it isn’t just fine tuning open weight LLM models. A few people I know who are thinking along the same lines with architectures like BERT etc.

That being said it’s much easier at the moment to continue to use the frontier providers for most general tasks, that is the argument I’ve heard.

For creating these types of fine tuned local models, on constrained hardware for inference, I do think this is the way to go for specific tasks too!