The Amanda Knox Test: How an Hour on the Internet Beats a Year in the Courtroom
lesswrong.com
lesswrong.com
Criminal justice systems are hard. They're right up their with the hardest things humanity has to deal with. They deal with ambiguous facts, necessarily inadequate rule systems and with intelligent human actors constantly trying to game the system - what's more the stakes are terrifyingly high, up to and including the life or death of the participants.
Sure, errors tragically occur. But we should really pause before pronouncing --- based on Bayes, blogs and journalists --- that the cursory judgement of a non-profesional who wasn't in the court is superior to the considered judgement of judge and jury made in full cognisance of the likely outcome of conviction after listening to all the evidence including first hand witness testimony.
And no, throwing in an offhand comment about how Occam's razor disproves God and therefore a little logic wielded with "courage and a certain kind of ruthlessness" enables superior thinkers to do better than the hidebound judge and jury (who were probably irrational Christians anyway) doesn't make the argument any more convincing.
And yes, the priors - like the probability that a 20 year old female college student with no history of violence or mental disturbance of any kind would commit a murder - are certainly very relevant. That is one of the least violent categorizations of humans you can create. (In fact a more accurate prior would be even more miniscule: the probability that such a person would lead an elaborate team sex murder, an act so rare there is no term for it.)
(However, there is some other evidence that is hard to deal with in this model, like the crime lab saying that there is Knox DNA on the bloody bra clasp of the victim. That evidence seems hopelessly entangled with the murder. How can this model be used to reason about it?)
Anyway, all I know of the case is what other commenters here and the OP on lesswrong.com wrote, so my facts are suspect. I've just tried to explain what the OP is saying. Did I succeed?
The OP would say that his framework is the only rational one.
The legal system doesn't work on Bayesian analysis. It has a probability system defined based on the meaning of English words... http://en.wikipedia.org/wiki/Burden_of_proof#Standards_for_d...
Here's another question: what a friend of the victim had testified that the victim had called sometime around the believed time of death and choked out, "Guede and Knox did it!"? If we're imagining that we don't know if there is a murder, then someone doing that isn't all that damnning, since hey, "it" could be any silly little thing? Yet it sounds pretty bad. Aha! Guede's name there associates something he did with Knox and it's agreed that he only did one thing of note in her apartment that day. OK, can we make a fact that would be more entangled? Yes: what if she said in that dying phone call, "Knox killed me"? Then aren't we saying that we only add the additional evidence of a roommate who isn't thought to be dead uttering that sentence? People say things like that all the time using "killed" as a metaphor for all sorts of innocent things. Yet it seems pretty damning. Can we really untangle the murder from the other evidence? I mean, the probability that the victim would at that moment use the word "killed" to mean something other than "stuck a knife in my throat" seems really low. And I think there is some similar entanglement with the other facts I've mentioned, too. The fact of the murder seems to make this technique faulty.
To me, I think this first line should read ".. since it's agreed that Guede was found guilty for his involvement in a murder that, due to extensive crime scene analysis, was clearly committed by multiple assailants". So I'm not sure why we must "start over, from scratch, as if the victim were still alive".
Furthermore, keep in mind that the evidence includes an initial written statement from Knox that implicates her in the murder.
False written statements are often signed in police stations.
Specifically parts of the article that discredit the body of evidence from the Judge's report (http://www.truejustice.org/ee/index.php?/tjmk/comments/under...) that supports a multiple-assailant theory?
I don't know much about the case; I'm interested in the OP's model of thinking about cases.
The comments on the post relate further evidence that was missing from the analysis the poster provides. Why? Because the poster made a judgement call that it wasn't relevant. That alone makes this just so much blathering... sorry.
There is a reasonable doubt.
What evidence is missing from the internet that makes them guilty? I guess we will find out in a few months when the judge and jury issue their written explanation.
Is anyone willing to state that they are certain Knox and Solecito are guilty of murder?
(a) It isn't zero-sum. Guede was convicted -- he is guilty, he did it. What we are determining is whether he acted alone.
(b) The priors are crap because they are weak, not because they are agreed upon. This is just a model, and it feels to me that the author is overfitting. The prior you mentioned as an example is so far away from the case at hand to be virtually useless.
In the article actual physical evidence is dismissed because it's "small in quantity". The amount of blood is far less important than whose blood it is. You only need a little dna to prove contact. And you only need a little blood to prove prescence at the scene of an injury. It sounds to me like the jury was doing it's job and the article's author was just looking for a point to make.
To put this another way, have a think about where you would expect your own DNA to show up. At home, at your partner's appartment, at the office, at the cafe around the corner from the office, in your car, in your partner's car, at your best friend's home, your best friend's car. If a murder ever took place in one of these locations, how would you feel about the presence of your DNA being used to implicate you in the murder?
But I strongly disagree on your understanding of the impact of priors. There are several ways to look at it, all equivalent. The easiest is the single prior: Did she do it? None of us are psychic, so that isn't helpful, 'cause we cant estimate it at all. We have to break that down into some of its components.
In fact, your argument (which I totally agree with, BTW) is based on a very specific prior: that in cases with this kind of relative imbalance of evidence, there is a high prob that one party is guilty and the other isn't (or some such, I may not be stating it as specifically as I should be).
All the evidence presented has it's own implied priors, and the right combination of evidence has it's own prior, etc. These all need to be combined with weights based on other priors. Since noone can compute all of these priors in the space of one hour, that makes it all a judgment call, not a rational decision.
And this is where I think the post's pontificating gets it terribly wrong. There's nothing rational at all about the process, other than you're attempting to blindly apply the Bayesian formula.
I do think your definition of a prior is a bit off though... like, the choices around priors wouldn't be whether to use "did she do it" vs the imbalances of evidence or such. We're trying to estimate the likelihood of "did she do it," so the question is what do we use to do that? The prior probability of "she did it" has to be the probability that some random member of the 20/female/american/student general public will commit the murder, because we don't have anything more than that (as you said). Then, we update our estimate by looking at the available evidence (such as, "was found standing by door holding bleach mop," which would the viewed in terms of the likelihood that that would be observed and the statement 'she did not do it' being true) to come to our posterior probability, which is the estimate informed by all of the available evidence.
As a side note, it's great when you can have a civil discussion on the internet. Maybe there's hope for HN after all.
More strongly the author is trying to argue that its an easy fallacy to get drawn into psychological motives because we're "great" at modeling other people's thoughts. In light of this implicitly perceived strength we tend to ignore the real likelihood of the evidences.
I don't know if it's something I agree about, however. I haven't personally reviewed the evidence and don't particularly put a lot of trust in any of the sources including the Less Wrong contributors.
See also: the experimental portion of this essay http://lesswrong.com/lw/1j7/the_amanda_knox_test_how_an_hour...
- 4 mixed DNA samples of the Knox and Kercher. Bloody footprints that match. Blood on the tap put Knox at the crime scene that evening or in the early morning.
- A bloody bra in the washing machine
- Attempts to frame an innocent man for the crime.
- Repeated lying to authorities regarding her whereabouts. Still no fixed alibi.
- Knox and Kercher's house was cleaned with bleach.
- Sollecito's trainers were cleaned with bleach. A defect in the sole match a blood print on the scene.
The decision went through going through 19 expert judges and 6 lay judges. Conviction was unanimous.
Certainly, we can ignore some of the strange behaviour of the convicted (the phone calls, the lies, her past). But the case is much stronger than what this article makes out.
This is an English translation of the judge's summary:
http://www.zimbio.com/Amanda+Knox/articles/58/Understanding+...
Other links:
http://truejustice.org/ee/index.php?/tjmk/comments/how_the_m...
http://www.truejustice.org/ee/index.php?/tjmk/comments/why_d...
http://truejustice.org/ee/index.php?/tjmk/comments/highlight...
http://www.timesonline.co.uk/tol/news/world/europe/article36...
http://www.guardian.co.uk/world/2009/feb/08/kercher-trial-kn...
edit: I left out a few other key points to the prosecutions case:
- Eye witness putting all 3 suspects together outside the cottage that night, and the night previous.
- Knox and Sollecito standing outside the crime scene when the police arrived with mop and bucket.
Rational thought takes anyone first to the conclusion that there was more than one killer. Guede left the scene soon after the murder (eye witness reports; evidence of cleaning, Guede's own statement). It is clear the crime scene was later returned to, and altered to cover evidence (faked break-in; footprints; removal of bra from the body). With all the additional evidence against Knox and Sollecito, physical and circumstantial, clear motive, and consitantly irrational behaviour, gives a very strong prosecution case.
This article touches on little of these facts.
Regarding these points: - Eye witness putting all 3 suspects together outside the cottage that night, and the night previous.
- Knox and Sollecito standing outside the crime scene when the police arrived with mop and bucket.
From what I read these were given by unreliable sources (drunk homeless man)
The police comes out pretty tainted in my opinion and it seems they were eager to find scapegoats early in the investigation.
Also, I don't find a clear motive for Knox/Sollecito. Not participating in a sex orgy?? It seems more probable that Guede raped and then murdered the victim. Also, in the initial testimony guede doesn't mention Knox or Sollecito being involved
I will reply to your points in turn, but to be clear, I'm not specifically arguing for or against the conviction; I'm saying that this article grossly ignores many of the facts of the case.
It appears that large parts of the American media have painted this case as some loon prosecutor bent on convicting an American girl with flimsy flawed evidence and a fanciful idea of some Satanic sexy orgy gone wrong. There's been a lot of column inches devoted to discussing some of the things this article breaks down (the strange behaviour, the telephone calls). I can understand the media focusing on this (it's what the public find interesting, not the detailed crime scene details). But as this article is about digging for information and applying reasonable thought, it's disappointing they chose to ignore the large body of evidence presented at the trial that lead to their conviction.
To your counterpoints:
1. If I recall, there is good (not the drunk homeless man) eyewitness testimony of the 3 meeting prior to the night in question.
- There is fair amount of DNA evidence (see my parent post, and the links). Yes, some may appear potentially flawed (e.g. bra clasp). However the judge considered and admitted the evidence. Consider that a panel of legal experts considered and unanimously convicted based on this evidence.
- From truejustice.org regarding evidence of a cleanup: "The ONLY fingerprints of Amanda Knox in the entire house were found on a glass in the kitchen. Even in her own room there was not one print."
- Yes, the eyewitness isn't great. But again, the evidence was admitted by the judge for reasons given in the judge's summary.
- The police themselves were the eyewitnesses to them being at the crime scene with mop and bucket.
- Whether the police appear tainted is worth considering, but doesn't explain away a body of hard evidence that was admitted in court.
- Your theory that Guede was a lone-wolf rape and murderer was quickly dismissed by the judge, given the huge body of physical evidence suggesting other people involved (again, see my post and the report).
edit:
This is a great link that goes over some of your points (motive, DNA evidence etc:
http://truejustice.org/ee/index.php?/tjmk/comments/how_the_m...
http://www.truejustice.org/ee/index.php?/tjmk/comments/under... http://www.truejustice.org/ee/index.php?/tjmk/comments/under... http://www.truejustice.org/ee/index.php?/tjmk/comments/under... http://www.truejustice.org/ee/index.php?/tjmk/comments/under...
I don't think the quantitative probability analysis of the Less Wrong thread is that meaningful in the semantics of the analysis itself, but I think it shows that a reasonable person would have a qualitative reasonable doubt about the murder.
I'm not sure the relevance of them being allowed to lie in court; no one is suggested they have committed perjury.
BTW, what a lot of people are saying in Italy is that she'll probably be let off on appeal.
That depends on your jurisdiction. I'm not familiar with Italy, but most U.S. states and the federal government do not require actually personally causing death as an element of the crime of murder. If you're a) engaged in the commission of a felony (sometimes, an enumerated list of "really bad felonies") and b) someone dies with cause proximate to the felony you're committing, you just earned yourself a murder charge, regardless of who pulled the trigger. This is called "felony murder". The most common use case is suspects A, B, and C attempt armed robbery on D, D dies in the attempt, and A, B, and C each admit to the robbery but not to the killing. Absent the felony murder theory, you might have to sift through confusing physical evidence and unreliable testimony of self-interested shady characters. With felony murder, your options are simpler: charge 'em all.
Imagine that one criminal has good leadership skills and is able to manipulate another, weaker criminal. He could then convince the weaker criminal to pull the trigger and escape consequences himself, and then do it again and again with different weak criminals. By sharing the blame the system compels the leader, whoever he is, to restrain the underlings rather than push them to the extreme.
No. Murder, and Rape, commonly promote the crime from conspiracy/accomplice to the full crime (murder, rape). Presumably because the stakes are so high for these types of crime, and traditional sentencing for 'accomplice to...' or 'conspiracy to commit' cases is so much lower, that people could game the justice system somewhat.
For example, if you hire a hitman to take out your wife/husband, you WILL be tried as the murderer, as will the hitman. If you conspire with a lover to kill someone, you will be tried as a murderer, no matter who is holding the murder weapon.
Perhaps it's different in America, although I'm sure there have been cases I've heard about in the US that fall under the same rules as those above, and where the conspirators were tried as murderers themselves.
Edited to clarify that I meant to point out two issues rather than one.
I live near Leeds, where Ms Kercher was from, and the local media has been very detailed about the hard evidence, and painted the case in a way that has been very hard to misunderstand.
Now, admittedly the local media is likely biased as well, just in the opposite way to perhaps the American media has reported this case. But I wasn't aware there was this reporting of Ms Knox as being utterly innocent. If anything, it was clear from the reporting I've seen that she's a sociopath/psychopath trying to manipulate the court with her 'I'm soooo innocent' act.
On the other hand, http://knoxarchives.blogspot.com/2009/12/magical-bra-strap-f...
http://lesswrong.com/lw/1j7/the_amanda_knox_test_how_an_hour...