What's your cost model / pricing based on here? If you're going to provide $20/month for unlimited APi calls, I can see this getting abused very reasily.
It may not turn out to be a perfect science, but in the name of shipping something and getting feedback, it's out there
Yeah right now we are renting GPUs, but at scale I would think we would own our own GPUs. As with any business, would probably go with the cheapest viable option