I used to take the same approach towards restaurant reviews on Yelp, which from personal experience caused me to miss a lot of great restaurants.
What I look for is a solid mix of 2/3/4 ratings, it's difficult to fake that, on the Play store you can balance the # of downloads against the # of reviews too and avoid stuff where 30 - 100 percent of 'downloaders' leave 5 star reviews.