Hacker News Reader

Comment by tinco | Hacker News Reader

Will you be offering the model as an API service? The product my team is working on would benefit from a significantly faster and possibly better performing model than GPT-4. If you're planning on keeping pace with competitive models we'd love to integrate the use of your model into our service.

View on HN

If we get enough demand that's definitely something we'll consider. We're still a small team, however, and we do everything in our power to not get distracted from our main mission.

Please consider releasing an API. Having a faster alternative to GPT-4 would be amazing for so many use cases.

Especially for agents that do function calling.

If you offer an API then you can be used with tools like https://aider.chat/, which is the best way to use LLMs for coding. But if only available via the web it's not possible. BTW this is the main reason I pay for the OpenAI API.

Makes sense, we're also very small (pre-seed) so definitely no cash cow for you guys yet. We probably shouldn't be prematurely optimizing our prompting performance as it's not really a bottleneck, but a 4x improvement just by swapping an API would be too good not to act on.

If you offer an API you don't have to maintain a Visual Studio plugin. Trying to compete with tools like Cursor would be the real distraction.

And Cursor is just the start - there will be innovative workflows built on top of APIs you can't predict. You're missing out not having developers build an ecosystem for you.

just as a point to consider, NOT having an api (and thus no integrations into my editors of choice) is the main reason i haven’t given y’all a fair test run. i’d almost rather not know what i’m missing (though the threads here have convinced me to give it a shot.)

Reply on news.ycombinator.com