Observability Stack – AI First?
Some background on my company: Mature (14 yrs) Ruby on Rails app, Sidekiq, Redis, PG, AWS lambda/eventbridge, react/preact, swift, and others. Hosted on Heroku. Very database heavy. Solo guy, owner/operator.
Current stack:
Datadog logging (dabbled in APM, metrics, and others, but the build pack for Heroku is so bloated I had to remove it), so now it's a simple Heroku log drain to datadog. I really miss the statsd host and APM stuff... but it took my slug size from ~250mb to over 350 and made booting and deploys much slower. I'd also like to get off Heroku.... some day... but I can't event fathom it.
Bugsnag for errors. Already moved this to Sentry to try out the AI stuff.
A little fed up with Datadog and receiving $600 monthly bills on top of my enterprise commitment. biggest pain points: indexing is priced per line, not by gb (discourages me from simple logging, so I resort to putting events into a single request/job log line, then have complex chunking of messages to split them up so that Heroku log drains don't destroy the json).
The complexity of configuring datadog was a pain point, but AI has mostly solved that.
I want an all in one tool... it seems that would be best for AI to have all the context in one place. However, sentry logs is pretty green, slow, and doesn't do much. I tried BetterStack, again, pretty basic. Pricing is similar to datadog anyway. I do about 600gb + 50M lines a month.
So I've come to the conclusion that Datadog logs are still so much better than anything out there. But Sentry is quite a bit better for errors (I also have other projects: iOS app, react, vanilla JS).
Any tips? I love putting time into this stuff, it makes me so happy when I have to fix something and it's all there, but at some point - like the reason for using Heroku - I have a lot of other stuff I need to focus on.
The main reason for exploring a switch is to automate root cause analysis, bug fixing, performance improvements, etc. Im still a noobie with Claude, right now I'm just using it as a pair programmer in Claude Code vscode chat, sometimes CLI.