HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by mrv_asura | Hacker News Reader
Full thread
mrv_asura
·
Awesome! Curious how you guys manage to make it "75% cheaper"?
View on HN
aikin-nivedit
·
Bunch of optimisations for large data, including: Smart Batching, Prompt Caching, Custom Routing Algorithms and hardware planning for batch.
Reply on news.ycombinator.com