Smaller tool calling models are absolutely needed when we are trying to apply agentic workflow to on-device, small systems, where data is private.
I currently use small general purpose LLM. But a special finetune is always the way. I'll try this for my use case.