How (not) to forecast an election: Analysis via a hierarchical Bayesian model
datart.com.br
datart.com.br
And statisticians have pointed out the inherent limits to surveys/polls in election forecasting since at least the Literary Digest debacle; a particularly good discussion is in Schlaifer 1959 https://www.gwern.net/docs/statistics/1959-schlaifer-probabi... (excerpt: https://www.reddit.com/r/slatestarcodex/comments/5c10jx/post... )
I have an alternative explanation for this : people who buy newspapers and mainstream web sites are liberal. Pollsters and analysts who wish to make a living must get clicks and sell copy. The ones that create models that agree with the general zeitgeist of the liberal milieu get clicks and sell copy, other models are gradually ground to extinction.
Markets are not efficient mechanisms for creating insight.
Early in the campaign, Trump acknowledged his media advantage. “I’ve gotten so much free advertising, it’s like nothing I’d have expected,” he told the New York Times in September. “When you look at cable television, a lot of the programs are 100% Trump, so why would you need more Trump during the commercial breaks?”[1]
[1]http://www.marketwatch.com/story/trump-has-gotten-nearly-3-b...
http://www.politico.com/blogs/on-media/2016/02/les-moonves-t...
The particular example I have provided is from Fox News because it was quick to search for, but I suspect you could find similar elsewhere about other news organizations.
[0]: https://twitter.com/FoxNews/status/787078152895901696/photo/...
1. http://www.salon.com/2016/11/09/the-hillary-clinton-campaign...
Perhaps polling is just more or less accurate because fewer people take part in polls.
Or the opposite - a voting abstentionist might be more likely to take a position when polled.
[1]http://elections.huffingtonpost.com/pollster/2016-general-el...
why would that be, though?
This will be obvious if you look at the weighting and questions 'Would you vote for Obama or Trump'. Reuters/Ipsos and other outlets had to change the way they did the polls after Trump was leading.
Predictwise was calling ~90% for Hillary and 320ish in the college.
PredictWise's mistake was that it assumed polling errors would not be correlated[1]. (He actually had a fight with Nate Silver over this.)
Nate Silver had, in advance, stated that polling errors would be correlated[2] (rightfully, as it turned out), which is part of why 538's model turned out to be closer to reality than PredictWise's.
The actual betting markets, which PredictWise was pulling data from, were in the range of 20-30% Trump. Much more bullish.
[1] http://predictwise.com/blog/2016/09/poll-aggregation-fight/
[2] http://fivethirtyeight.com/features/election-update-why-our-...
While beyond the scope of this article, it would be great see more research done into the relative strengths of each bias, i.e. which biases are skewing polls the most, rather than just using lumped bias terms. Though I did see after Brexit forecasts got it wrong too the British Polling Council is "looking into it".
What's most interesting is there wasn't more of an effort by the media to get accurate vote forecasts before the election. Granted, it's more expensive and takes longer but it's not terribly difficult to do. It does involve a research team and statisticians spending time in person in the state and getting deeper data from people. But the time/costs aren't as outrageous as one would think because it only needs to be done in the handful of close swing states. And a sample size of just a few hundred people is enough to get significant results. Seems obvious and worthwhile, maybe in 2020 they figure it out.