pretty sure it's only comments you get the ability to downvote once reaching a certain threshold. Stories you can flag or upvote, but I've never seen a downvote for them.

For comments yes, but can anyone actually downvote stories?