I don't know if it is a karma threshold or not, but I have never been able to downvote a post and/or comment. Only upvote or flag.