What about the Wilson score confidence interval mentioned here?
http://www.evanmiller.org/how-not-to-sort-by-average-rating....
http://www.evanmiller.org/how-not-to-sort-by-average-rating....
Not sure how sound my math is, but it seems to produce the desired results.