Ask HN: Any tools or frameworks to monitor the usage of OpenAI API keys?

4 pointsterrortang4 comments

I am currently developing an application using OpenAI, and have created distinct API keys to accommodate varying scenarios. However, I've found that managing the usage of these individual API keys isn't as seamless as I would like. Do you know any tools or frameworks specifically for controlling or monitoring the usage of these different API keys?

View on HN

Maybe try https://github.com/langfuse/langfuse

It was recently shared on HN

Thanks, will take a look.

Langfuse founder here

Do the API keys map to end users / customers? If yes reporting via Langfuse (UI & GET API) can solve this.

If that's not why you use multiple API keys, you can add an api key id/hash (to not store the key in langfuse) as metadata and then group/filter by this metadata field.

Dm me on Discord[1] if you have more detailed questions.

[1] https://langfuse.com/discord

Langfuse is great ! Also check https://www.nebuly.com/

Reply on news.ycombinator.com