How do you design telling engagement metrics?

With tools like mixpanel it's very easy to collect lots of data on your app's usage. But what are people's strategies for turning raw data into KPIs? You want a measure to be robust to outliers, to really correspond to how often the product is used, but also to how often the users is `successful'. Would love to hear tips on getting this right