The algorithm might not take it into account but it's useful for viewers to see how downvoted a video is. If I see that it's 50% downvoted then I know the contents to be controversial.