4 karma · joined January 4, 2025
Yes Opus has been good with instruction following and same with Gemini for 2nd opinions and brainstorming.
They're not perfect but definitely I see plenty of value in both tools as far as they are reliable services.
I don't like the cloud based functioning of the models as the experience is extremely flaky and not reliable. I've gound OpenAI Codex and the models in codex too be more reliable in responses and consistency of the quality service.
I would still prefer to have a fully locally hosted equivalent of what ever the state of the art coding assisstant models to speed up work.
That will take time though as in with every technological evolution. We will be stuck with time sharing for sometime haha. Until the resource aspect of this technology scales and economizes to become ubiquitous.
Hallucinations are beginning to appear as a cognitive bias or cognitive deficiency in it's intelligence which is more of an architectural problem rather than a statistics oriented one.
For example in the next few years if Operating System companies and PC producers make small local models stock standards to improve the operating system functions and other services. This local LLM engine layer can be used by browser applications too and that being done through WASM without having to write Javascript and using WASM sandboxed layer to safely expose the this system LLM Engine Layer.
To summarise the Agent Mode editors don't try to fill in their context gaps and be aware of the environment they operate it unless explicitly specified by the prompter to first review the codebase, understand it's structure and then proceed with implementing features.