I wonder if some sort of caching might help lower costs.
There's intentionally no caching, every batch is warm from the AI oven.
HN usually drives around 10k visits, so organically it's going to be well within my Saturday night budget. If someone decides to hammer it, well, the OpenAI account has a hard limit of $20/month. It will live until it's killed I guess.
You have to account for this not being a regular visit, but rather (I guess) 5-50 "visits" per visit, as people mash F5 to get more titles.
> OpenAI account has a hard limit of $20/month
That makes me feel better about the couple refreshes I did myself :).
It happened after I mentioned “just be kind, please! Theoretically this could cost a lot of money.”
So there’s at least one person who will do exactly this just for fun.
Firebase customer support was super cool about it, but it still knocked us off the paid tier.
think of all the money you have saved by not having to hire a hundred engineers to maintain your website's infrastructure!