Machine Learning Meets Economics, Part 2
blog.mldb.ai
blog.mldb.ai
> “Exactly,” agreed Danielle, “and just like with the previous project, the model will get some wrong, but this will be outweighed by the cost savings of not having to check every single gadget.”
And that's how we consumers go from being able to receive a 100% reliable product every time (i.e. "Quinn's team works very hard to avoid penalties") to needing to go through the hassle/delay/cost of returns. Sure the QA department "has to pay" for the return, but does that economic model accurately include the cost of lost goodwill?
It's kind of frustrating when you're trying to sell ML-based solutions to a skeptic. I've found that executives will often try to poke holes in the predictions, especially if the ML solution is risky or potentially threatening to them.
It helps a lot to frame things with a known human error rate and cost, as the Data Scientist in the story does, because then the conversation becomes win-win (how do we optimize for best outcomes) rather than unwinnable (why isn't your fancy ML algorithm right about this example X which I can plainly see myself is wrong??).
In particular, automation that reduces headcount reduces their justifiable budget and therefore power within the firm, salary and benefits, and external status. For an example of the latter, Havard Business School asks you how many people you are currently managing when you apply for an MBA.
This creates a strong incentive to block any attempts at automation or increased efficiency, especially when said inefficiency is not reflected on the KPIs used to gauge the executive's performance. Customer satisfaction and error rates are rarely measured well, nor with a refresh rate sufficiently high to be such a KPI. Blocking is easiest to do by seeding mistrust in the person attempting to build the automation, and in the automation itself.
Part of being an effective data scientist/big data engineer/whatever the buzzword du jour is consists of figuring out what KPIs the executive wants to maximise and sell him on that instead. The good old "work on making your boss look good".
Of course this has been understood for a while: cf https://en.wikipedia.org/wiki/Acceptance_sampling . In fact there's a whole ISO standard (2859) on how to do proper statistical sampling.
Ten years ago or more, lumber mills started using computer techniques to suggest optimal cuts (which dimensions you can get out of a given log, understanding that larger dimension lumber has higher sale value per unit mass), and flashing the suggested cuts to an operator for review/approval, which only rarely is overridden.
So what's holding them back from replacing the cutter with a machine as well?
A human being is remarkable flexible that can do lots of things robots and computers can't do as well as program himself/herself quickly to do things it takes a long time to program a computer to do.
If a human being is also really cheap, and they are in many places, then a human being is a really good deal. And the situation of automation and (even more) the globalization of work, is that it reduces the margin price of labor - there's still demand for people but the demand for people at a lower price - and being flexible, people have accommodated.
But when life is cheap and work is constant, it degrades all those things that makes human society pleasant. Except for those few with money to burn and to some extent even for them.
What do you imagine they will be? What about economic benefits?
Economic transactions will start to look very different than what's normally accepted today.