why run it at a loss? Market is flooded with LLM gateways, free ones too. what's your ICP?
We don't run at a loss. Our volume discounts allow us to earn our margin. i.e., if we make 5% from a provider we can afford to eat 3% in fees. There are no LLM gateways that companies trust in production. Our ICP is big token spenders. One customer last week spent $100K in one day.