In terms of learning new things, the vote count helps tremendously! You can tell that a security-related suggestion earning 50 up votes is sound (of course considering context), technology-wise. I've learned a lot about passwords, plaintext, server-side hashing, salting and related best-practices solely from HN comments.
Displaying scores might make the other aspects troubling (since group-think is supported unnecessarily, often disregarding novel thoughts or disagreements). But I've learned to ignore such things, especially since most of the conflicts are "opinions" anyway, so the value addition is somewhat limited.
In terms of actual facts and expertise though, nothing can beat the vote count!
Having said that, I am still not sure which one I prefer given that there is inherently a tradeoff between the two aspects.