Hacker News Reader

One thing I noticed is that there's no cost tracking, so it's very hard to predict how much you're spending. This is fine on tools like Cursor that are all inclusive, but is something that is really necessary if you're bringing your own API keys.

Is this feature on the roadmap?

View on HN

This is a great suggestion. We're actually storing the input/output costs of most models, but aren't computing cost estimates yet. Definitely something to add. My only hesitation is that token-based cost estimates may not be accurate (most models do not provide their tokenizers, so you have to eg. estimate the average number of characters per token in order to compute the cost, and this may vary per model).

It'd probably be useful to just show cost after the fact based on the usage returned from the API. Even if I don't know how much my first request will cost, if I know my last request cost x cents then I can probably have a good idea from there.

Reply on news.ycombinator.com