I third using Sentry. I love it. David has been making huge improvements in the Ruby client in recent weeks.