That said, they can work. Twitter famously did something like that for their time-based vs algorithmic feed and I think YouTube does it pretty regularly.
The biggest issue, though, is that by the time you get results from any long-term experiments, most of the decision-makers (PMs, EMs, etc) have probably moved on away having taken credit for the short-term wins they delivered.