Maybe try https://github.com/langfuse/langfuse
It was recently shared on HN
It was recently shared on HN
Do the API keys map to end users / customers? If yes reporting via Langfuse (UI & GET API) can solve this.
If that's not why you use multiple API keys, you can add an api key id/hash (to not store the key in langfuse) as metadata and then group/filter by this metadata field.
Dm me on Discord[1] if you have more detailed questions.