Hacker News Reader

Full thread

ashu1461

If we compare this with using the older solution of writing a prompt to find out the answer of the classification

- Cost : It is the same for both scenarios $0.10 per 1M tokens

- Speed : decisions is 10x faster than responses API

- Quality : I guess if we compare with luna which is a pretty good model it itself, both will be at par

So essentially it has to do more with speed vs any other factor.

View on HN

With decisions models, you don't pay for output tokens. Also this OpenAI API is multimodal.

Output tokens anyway will be minimal in a decision scenario, so even if you use responses API the cost will be less.

Not exactly. System 2 style reasoning to follow instructions can be expensive and counts as output tokens.

If there is reasoning involved, the output can't be this fast ?

I tried out the multimodality and this is the biggest win, imo.

You can give it a CCTV image (like of a train platform) and ask it to quickly decide actions such as triggering an automated auditory alert, deferring to a larger model for more detailed analysis, etc.

Reply on news.ycombinator.com