I think this post by Dan G. the other day both supports your hypotheses (about the down votes) and undermines it. Either way, I recommend reading it.

https://news.ycombinator.com/item?id=19214965