396 karma · joined March 27, 2019
- Cost : It is the same for both scenarios $0.10 per 1M tokens
- Speed : decisions is 10x faster than responses API
- Quality : I guess if we compare with luna which is a pretty good model it itself, both will be at par
So essentially it has to do more with speed vs any other factor.
While doing local development where your environment is already setup and dependencies are installed doing something like this seems viable after the initial effort.
But how would this work in a software-factory setup, where coding agents run on fresh VMs or when using something like Claude Code on the web? How do you quickly recreate the required environment and dependencies there?
With autocomplete, I'm still writing the content and simply using AI to phrase it better. With generation, it may produce something that was not part of my original idea and once it is there, it becomes very hard to remove its bias.
Linearly written code is much easier to understand and scan.
Wondering what the actual verification loop looks like once you start taking these systems to production.
https://ashu1461.com/posts/a-calorie-tracker-on-my-garmin-wa...
Claude really helped in doing the heavy lifting.
https://github.com/aurelio-labs/semantic-router
I guess it is based on the same fundamentals as well.
The idea is to make structured queries using these protocols which can be used to fetch top products matching the user needs instead of just relying on semantic search.
https://developers.openai.com/commerce/specs/file-upload/pro...
Mojo addresses the actual need to write code in other languages, such as C++ or CUDA, for low level and hardware specific work.
But I wonder if it has already missed the AI hype cycle, when a lot of low level code is being written. I'm not sure how the developer ecosystem will react now.
Smaller models are suitable for simple tasks like classification / summarisation while larger models are better in agentic capabilities.
The factors that used to influence the build vs. buy decision are now changing. Earlier, even small tools like Canny (which shows your product roadmap to your customers), link-in-bio tools, or even Calendly used to sell well. I foresee that changing.
https://developers.cloudflare.com/bots/additional-configurat...
How is this different than the capabilities which cowork by claude / chat gpt desktop apps now a days give in terms of core capabilities.
The fact that you can maybe fetch bugs from jira and present in the way you want is true for any of the agentic orchestrators, so is it really the USP ?
One difference I found against other orchestrators was that they work on a per seat billing model. Example if you have 10 team members who want access to a shared agent infrastructure, you would end up paying 10 * 20$ = 200$ per month while in this case it is probably just the AI and infrastructure bill that you have to spend, which probably might cross 200 dollars as well.