Comments like this amaze me. People really think these giant corps are out here not doing things like this.
Comments like this amaze me. People really think these giant corps are out here not doing things like this.
The business world runs at least as much on bullshit as the most cynical among us might think, I'd say. It's not half as clever or competently-run as one might hope, certainly.
It's a cliche that front-line workers have a better understanding of customers and products than the c-suite and that this leads to predictable blunders, because that's often true.
(I'm also not sure I'd call Reddit a "giant corp", but that's beside the point [EDIT] and anyway, to be fair, this particular discussion isn't just concerned with Reddit)
You should assume that any numbers shared publicly are just the tip of a giant-ass iceberg and that there were probably 10x more analyses going on internally that weren't shared.
The thing that ultimately gets shared publicly is whatever avoids using advanced stats or internal jargon; They want a single soundbite, not a scientific paper with a full methods section.
After a year with not much to show for it, the VP for the silo starts to put out kudos for the team for break-even revenue impact. However, behind the scenes, the insight they were taking credit for was a common sense idea that had already been in the e-commerce team’s backlog.
Nothing surprises me when a company says that they’ve run the numbers.
But... most businesses aren't that complex, and people can usually come up with really good common sense ideas for how to make improvements.
Data-science is often most effective when it serves less as a visionary idea-maker and more as translator that helps common-sense ideas become real (optimizing values, figuring out the best roll-out strategies, building forecasts).
They might have chosen to ignore them. They might have fed biased assumptions into their calculations. Project management might have messed up and deprioritized the features meant to placate that section of the userbase. Institutional churn might have resulted in the corporation forgetting that they ever did run those numbers or why they are now heading down this path.
And yes comments like this amaze me too.