Could it just be the comment is too old? IIRC, comments that are over ~24h old can no longer be downvoted.