In my experience, if a good comment that is "not in-line with the majority crowd" gets downvoted, it will bounce back up quickly. On the other hand, poor-quality comments stay voted down over time.