Thank you for sharing. I'm running Gemma4:12b and qwen-coder-next MoE on my local RTX5080 (yes, 16Gb). Using them for local agentic tasks with tools and MCP tools usage. Both hallucinating on my setup. Do you have a rating for most appropriate local models for local agenting tasks? I also tried kimi2.6, qwen3.6 - no luck.
I'd try Qwen 3.6 35B-A3B or 27B with a temperature of around 0.6. You'd need to offload some of it to RAM though. I've had okay luck with Gemma 4 12B with a temperature of 1.0 but it will miss things a lot :(
Thank you. Gemma4:e4b with temperature 0.9 works pretty good with tools (Bash, Glob, Red/Write and WebFetch) And it is fast. Will try the Qwen 3.6 later today.