Thanks a lot for the feedback. I've just tried some different settings for the lower bounds of what will appear. As of now it seems like settings a minimum number of at least 3 votes makes the Top Rated list looks much better.

What do you think of this?