Hacker News Reader

Sorry, 100% of AI services now limit to x questions / day. It's impossible to be practical.

My expectation is, trained once, and "free questions" later. Why put number of questions/day in pricing though.

Predictable and practical pricing for me, should only depends on training data size.

Presumably because OpenAI charges per-request fees. These services aren't training an in-house model, but are leveraging an LLM via an API and they have to pay those fees.

(I'm not saying this to imply that building a service like this is simple just because an API is used - there's still a lot of plumbing work and designing a way to manage document embeddings, etc).

Reply on news.ycombinator.com