Hacker News Reader

Comment by krystofee | Hacker News Reader

Their docs show throughput limits (e.g., 4 CPU = 60 errors/sec), but what happens during error spikes?

If my app crashes and blasts hundreds of errors in seconds, does Telebugs have built-in rate limiting or backpressure? Or do I need to overprovision hardware/implement throttling myself?

With SaaS tools, spike protection is their problem. With self-hosted, I’m worried about overwhelming my own infrastructure without adding complexity.

Anyone running this in production?

View on HN

Hey, Telebugs creator here. Great questions! Right now, Telebugs doesn’t have built-in throttling, so during error spikes, you’d either need to handle it manually or overprovision. I do plan to add throttling in the future, similar to what Sentry does, to protect your infrastructure automatically.

Curious: for those running self-hosted error trackers in production, how do you currently handle sudden error spikes? Any clever tricks or patterns you swear by?

The company I work for runs self hosted sentry. Sentry has something that tells you that events are being dropped due to pressure. I think every engineer in the company knows that this is happening but no one fixes it because no one has the time to look into it.

Thanks for your answer! Would you mind sharing your error volume? I’m also curious, how often do dropped events happen, and how does it impact your workflow? Any workarounds you’ve tried, or features you wish were available? This will help me make sure the feature is implemented in a way that’s actually useful.

That seems like insanely low throughput. What takes it so long?

It uses SQLite as its database.

SQLite is really fast. There's no way that's the bottleneck.

What’s your experience with SQLite? It’s a bit hard to talk about performance without sharing code.

I've used it a fair bit. My biggest use was for a computer processing system that recorded gigabytes of data. If it was limited to 60 inserts per second it would have taken months to run!

I do recall having to change some settings to make it really fast, but it wasn't 60/second slow.

See the "update" in this answer.

https://www.sqlite.org/faq.html#q19

Appreciate the answer! You’ve probably worked with raw SQLite drivers. I’m using a framework, which likely runs more transactions by default. I’m fairly confident that with a bit of digging, I can improve the ingestion speed. Good to know and thanks for sharing your experience!

Reply on news.ycombinator.com