Pro tip: if you truly want to build an open source community around this. Don’t build your community using proprietary chat platforms (ie, slack). Slack in particular only keeps a small amount of history.
They have an observability platform for LLMs and other generative AI services. Just like you can use observability tools on services like databases or APIs, they’ve made an observability tool for the aforementioned AI services and the applications built with them. They use OpenTelemetry, a pretty standard observability protocol, to interoperate with other tools that ingest observability-oriented data.
Though if you'd like to see something more, Lemme know!
Thanks!
Thanks for the suggestion on community (Not Slack). I Created a Discord server now, Feel free to spam questions, suggestions! Thanks for the feedback!