Yes, the restrictions are interesting -- I've personally noticed (corrections/additions welcome):

- Cannot downvote comments in threads older than 24 hours

- Cannot downvote comments in response to you