My argument is targeting at the whole "survey" business, not this or that dev team in particular. I would much prefer the dev team here to do a great job, "fixing" the broken online survey business instead of adding on to it. If you are part of the dev team, I apologize for the confusion.

Not sure how the "doll" analogy applies here. When a doll sells, even to a small proportion of population, it sells. When you do an online survey, you gain very little true insight. You definitely will gain more insight from the two alternatives I mentioned (analytics on logs, properly designed experiment).

Don't get me wrong, I am not saying the whole online survey industry is wrong. Amazon Turk is wonderful, so is SocialSci. My company actually use result from Turkers for building models. The premise for that to work is a well designed experiment with qualified turkers. A survey that replacing "paywall" basically means you do not have a clear targeted recruitment poll. You get basically anyone who pays your website a visit. Survey result from that, in my humble opinion, is worth as much as server log analytics.

p.s.: I think you meant "You are being off-base" instead of "Your being off-base" but I really want to avoid discussion on grammar on HN.