Good point. There's huge praise when an A/B test shows positive results. "Ship it, we've made the world better!"

So that feedback loop is going to incentivize short term thinking and small changes that might not be beneficial to the whole.