Hacker News Reader

Comment by mtae | Hacker News Reader

May I ask what about "Less Wrong-style rationality" you disagree with?

This is the kind of thing which could very easily turn into a flame war, and is much further off-topic. I'm not interested in that kind of argument right now, so all I will say in this thread is this:

My personal experience with Less Wrong-style rationalism, to simplify the situation aggressively, is that it has a core of good, useful tools (Bayesian reasoning, strict positivism, utilitarianism) that I have no problem with. However, when pushed too far, those tools tend to break down—but the rationalist answer to that breakdown is all too often to embrace the model and discount the reality. This general refusal to regard their core tools with suspicion results in beliefs which are paradoxically irrational: when faced with e.g., utilitarianism condoning torture to prevent mild discomfort, the rationalist response is not, "Perhaps human experience does not map straightforwardly to integers—we should re-examine our tools," but rather, "As our mathematical tools are of course correct, we must believe in this conclusion." This belief in math-over-matter is a major part (though not the only factor) in my skepticism towards the kind of rationalism promoted by Less Wrong.

And yet no one has really made an convincing argument of why the conclusions of utilitarianism contradict the axioms of utilitarianism. And no one seems to offer the rather simple solution that utility is non-linear (so dust in ones eye is really a quite small fraction as bad as a century of torture), and people who mock Eliezer's utilitarianism hypocritically do so on sweatshops built&recycled computers, clothes, and food.

The strongest argument against rationalist utilitarianism seems to be that people don't like the cognitive dissonance it imposes on hypocrites.

The linearity of utility is irrelevant to the dust specks or torture problem because you can always increase the number of people to receive dust specks so the utility of torturing a single individual for 50 years is higher.

http://lesswrong.com/lw/n3/circular_altruism/

And calling people hypocrites because things like involuntary organ donation gives them "cognitive dissonance" is absurd. Also regarding hypocrisy, note that Yudkowski works for an organization whose goal is to protect humanity from Skynet, while people in Africa are starving. (I'm not personally attacking him, he can work on whatever he likes, and I think governments of wealthy nations have both the resources and responsibility to alleviate starvation, and individual efforts are mostly pissing in the wind. But parent poster brought up sweatshops &c. so I went there.)

The really funny part of HPMOR is that, while it was intended to demonstrate rationalism, what I got out of it was that rationalism doesn't actually work.

I'm unwilling to post spoilers, which makes this unfairly undiscussable, but the meaning of the original prophecy did not--could not--come down to rationalism and could not for reasons that were repeated a few times through the fic. I can't tell if this was intentional on Yudkowsky's part, and I don't really care, since it really changes nothing about everything else.

For the record, though, when I disparage utilitarianism, I promise it isn't just "Eliezer's".

Deleted comment

>And yet no one has really made an convincing argument of why the conclusions of utilitarianism contradict the axioms of utilitarianism.

No, they've said "this is a reductio ad absurdum, perhaps reality is a bit more complicated than that." You don't get to assert your assumption - that simplistic utilitarianism works as advertised - as evidence.

Consider, for instance, minmaxing as an alternative. (Like real-life AI work tends to.) What answer does that give?

Thanks for explaining your views. My intent was not to spark a flame war, I've heard quite a few critiques of less wrong but most of the authors expressed their disagreement without explaining what they disagreed with (perhaps it was obvious to them).

Reply on news.ycombinator.com