The worker is alienated from (most of) the product of their labor. Until that changes, "productivity" doesn't benefit them, only their employers. Why should we want more of that?