The thresholdout method [0] for preventing overfitting on a test set is an interesting application of this.

Here's a talk on differential privacy applied to the overfitting problem [1]

[0] http://andyljones.tumblr.com/post/127547085623/holdout-reuse

[1] https://www.youtube.com/watch?v=9mqXjdnZA18