I'm using phi4 for writing, one of the qwen3s for coding and a small mistral for classification and other small tasks. Have a framework desktop showing up soon, will put a 70b/80b multimodal on it for image and pdf processing.
I have used ollama, lmstudio, jan and vllm at different times, am readying for a wholesale transition to llamacpp.