I recently created http://ribbot.com for this exact purpose.

And it's open source: https://github.com/barmstrong/ribbot

It's great to see companies adopting this model for support (validates my theory) and it looks like Stripe has stepped it up a notch design/feature wise which I think can inspire ribbot. Ribbot.com (hosted version) also supports custom domains etc.