It makes it more difficult for me to quickly scan the most "insightful" comments when determining whether or not to read the article.
So, if there is some correlation between the most "insightful" comments and those with the most upvotes, you should see them near the top (eventually, anyway).
Maybe a way to indicate that a certain branch represents X% of all votes? Dunno, stupid idea probably.