HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by jsemrau | Hacker News Reader
Parent
Full thread
jsemrau
·
How are you handling the unit costs, rate limits, and model risk?
View on HN
philip1209
·
That’s a deep question. Under the hood we use some LLM gateways like Helicone and
https://usevelvet.com
to track cost per request and optimize it.
Reply on news.ycombinator.com