Should be possible with optimised models, just drop all "generic" stuff and focus on coding performance.
There's no reason for a coding model to contain all of ao3 and wikipedia =)
There's no reason for a coding model to contain all of ao3 and wikipedia =)
If we knew how to create a SOTA coding model by just putting coding stuff in there, that is how we would build SOTA coding models.
Besides, programming is far from just knowing how to autocomplete syntax, you need a model that's proficient in the fields that the automation is placed in, otherwise they'll be no help in actually automating it.
I'm more bullish about small and medium sized models + efficient tool calling than I'm about LLMs too large to be run at home without $20k of hardware.
The model doesn't need to have the full knowledge of everything built into it when it has the toolset to fetch, cache and read any information available.
I had not considered that, seems like a great solution for local models that may be more resource-constrained.