Hacker News Reader

I try to batch requests and reuse responses wherever possible.LLM API calls are awesome,but if you don't watch your usage,cost sneaks up fast.

Agreed, are you doing anything to take advantage of cacheing?

Anything else you can share about project?