Indirectly: choose boring tech because it's well documented, widely supported, and training data for LLMs abound.
Do you run LLMs locally? I'd be keen to have an overview of your stack.
Do you run LLMs locally? I'd be keen to have an overview of your stack.
In the article, I mostly mean working with LLMs inside the applications I'm building, as opposed to as a tool as part of development. But I do both.
Right now, I'm trying out Zed, which supports multiple LLMs natively. Just today, I tried Zed + Ollama + Qwen 2.5 Coder 32B running locally, and it worked! Blows my mind that I can have GPT-4o-level assistance running on my laptop. :D
How do you gauge "GPT-4o-level assistance"? Have you tried side-by-side comparisons?