That's definitely one of these things you have to learn as part of running a business. You tend to over-index on things you can measure and under-index on things that you can't. After a while you realize there's a lot more randomness in what happens than you might expect and so you can't weight any particular data point too highly. If you look at patio11's blogging of Bingo Card Creator, you'll notice he has little idea as to why his userbase grows or shrinks any particular year: http://www.kalzumeus.com/2012/12/29/bingo-card-creator-and-o... And he's one of the most sophisticated product analytics experts out there!