This is an interesting topic. I automatically assume that it's a direct correlation to the type of visitors who use IE.
Here's a study from 2012 that shows IE users are prone to be significantly older than Chrome users, suggesting that your website appeals mainly to an older audience. (http://www.liveintent.com/news/advertising-technology/browse...)