I don't think that people are maliciously pushing your content to lower rankings. IMHO I think the amount of stories being submitted and actively voted on are whats pushing your content down further.