Show HN: OpenAI Cost Monitoring
My name is Ben Schaechter and I’m Co-Founder and CEO of https://vantage.sh - a cloud cost visibility and optimization platform. We just added support for monitoring OpenAI costs and usage to Vantage and I wanted to share a demo we put together with HN as I thought people might find it interesting:
https://www.youtube.com/watch?v=CzAOU1-uMrM
In early April we started getting requests from customers to add OpenAI cost support specifically as it was a bit opaque as to what exactly was driving costs. The way this works is that it uses an undocumented API available from OpenAI - I asked ChatGPT how to get this info and this is what it recommended. The OpenAI team said this was fine to use but is subject to change in the future which is why this feature is in beta right now.
This new integration uses an OpenAI API key to report on costs by organization, operation (i.e “Completion”), and model (i.e. “GPT-4”). It also allows you to forecast your OpenAI costs and set up billing alerts in Slack if costs begin to increase rapidly.
I’d love to know what people think on this and if you have any feedback good or bad for us to improve this moving forward. You can register an account and connect OpenAI in a few seconds here: https://console.vantage.sh/signup