Capitalism itself, can be viewed as just a giant paperclip maximizer.
Capitalism itself, can be viewed as just a giant paperclip maximizer.
There's a comic strip I saw once: looking at a post-apocaliptic scenario from skyscraper window, one executive turns to the other: "My god! We've brought about the apocalypse!", he replies: "Yes, but for one beautiful moment we created a lot of value for our shareholders.".
Also, nearly all human social systems have some kind of human values as the goal. Even the worst social systems, such as a dictatorship that tries to make a society that never contradicts the dictator, if it achieved its goals, would result in a world where humanity survived, friends met, lovers loved, and people continued to have interesting (though suboptimal) lives. In a world where an AI uses humanity to bootstrap itself into a universal paperclip replicator, then the AI achieving its goals would probably result in the destruction of the biosphere of possibly the only planet with life (or maybe the destruction of many planets' biospheres), and the total eradication of anything we would attach moral weight or value to.
I'm skeptical of that. The best example we have of intelligence is the human mind, and that has consistently proven to be very malleable.