Already been done. Look at the Forge project for local LLMs. It can bring 8b models up to Opus-like performance at tool calling.