I've been doin this for a while now. The problem is more mental than technical.

The first thing to accept is that this is by definition an irrisponsiable thing to do...;)

Then you need to flow with it. The main thing is not aiming at fixing everything as fast as possible but rather in a way that will be as reliable as possible. Or in other words, your primary consideration should not be an early alert on Friday night, but rather a wilingness to work the weekend making sure whatever happened will not happen again.

The tech details really depend on the specific application.