aithrowaway

Ok, I'll try that. Thanks.

From https://platform.openai.com/docs/guides/rate-limits/overview (emphasis mine):

GPT-4 rate limits

During the rollout of GPT-4, the model will have more aggressive rate limits to keep up with demand. You can view your current rate limits in the rate limits section of the account page. We are unable to accommodate requests for rate limit increases due to capacity constraints. We are prioritizing general access to GPT-4 first and will subsequently raise rate limits automatically as capacity allows.

I'm not talking about free tier limits. Paid users are being limited.

Yeah, I understood. I hope it's not true. Selfishly in part, since I don't have that kind of cash available, but also because one of OpenAI's founding principles is to "avoid undue concentration of power". Giving the latest models (sans very restrictive limits) to large or well-funded companies first would seem to violate this principle.

Being a small startup already puts you at a disadvantage. If established/funded companies are always getting the best model months ahead of you, it's really hard to compete even if you can make a better product.

Interesting. According to https://learn.microsoft.com/en-us/azure/ai-services/openai/q... >

"Quota increase requests can be submitted from the Quotas page of Azure OpenAI Studio. Please note that due to overwhelming demand, we are not currently approving new quota increase requests. Your request will be queued until it can be filled at a later time."

But I guess you're saying that exceptions can be made, which isn't too surprising I suppose. Frustrating though if true since this kind of preferential access would seem to run counter to OpenAI's stated mission and mean they (or MSFT at least) are picking winners rather than allowing the best product to win in the market.

If and when the rate limits aren't an issue, I'll probably go the typical route of charging some amount per month (probably 20-50 range), which includes some base number of tokens, then charge overage based on OpenAI costs plus a small markup (maybe 5-10%).

I think the tool could be useful enough that many users won't be too cost conscious, but I'll only find out for sure by launching it.