> The doomsday scenario is not a manufacturing A.I. transforming the entire planet into paper clips, as one famous thought experiment has imagined. It’s A.I.-supercharged corporations destroying the environment and the working class in their pursuit of shareholder value.
Well, yes. If the AI is better than human it will be put in charge of corporations, and will be given the goal of maximizing shareholder value. Since those shareholders can be corporations, there's no reason why this has to involve human preference at any point. As a single-minded optimizer indifferent to humans, it would need to be successfully restrained in order to be merely oppressive - by default, it's a Paperclipper.