http://librato.com is another hosted product (disclosure: I work on this) for systematically monitoring/managing applications.