Police relied on Clearview AI and put the wrong person in jail
nytimes.com
nytimes.com
In the United States, falsely accusing someone can be considered defamation or slander, depending on the circumstances.
Defamation is a legal term that refers to the act of making false statements about someone that damage their reputation. If the false statements are made in writing, such as in a blog post or social media post, it is called libel. If the false statements are made verbally, it is called slander.
To prove defamation or slander, the person who was falsely accused must demonstrate that the statements were false (he can), that they were published or spoken to a third party (they were -- to the police department), that they caused harm to the person's reputation (he lost a week from work and was put in jail -- not to mention countless articles that mention this fact), and that the person making the false statements acted with actual malice or negligence (they provided a service for money and didn't check their facts). Actual malice means that the person making the false statements knew they were false or acted with reckless disregard for the truth. I'm pretty sure 'reckless disregard for the truth' would be pretty easy to prove in this case -- considering Clearview probably can't say specifically why this person selected for arrest.
If a person is found guilty of defamation or slander, they may be required to pay damages to the person who was falsely accused to compensate for the harm caused to their reputation. The amount of damages can vary depending on the extent of the harm and the specific circumstances of the case.
> Except as provided in sections 1681n and 1681o of this title, no consumer may bring any action or proceeding in the nature of defamation, invasion of privacy, or negligence with respect to the reporting of information against any consumer reporting agency, any user of information, or any person who furnishes information to a consumer reporting agency, based on information disclosed pursuant to section 1681g, 1681h, or 1681m of this title, or based on information disclosed by a user of a consumer report to or for a consumer against whom the user has taken adverse action, based in whole or in part on the report except as to false information furnished with malice or willful intent to injure such consumer.
This country desperately needs a GDPR equivalent. One that does not except financial surveillance bureaus, the healthcare industry, or any other quasi-governmental organization that abuses our personal information.
So when you say 'does not benefit any defensible purpose of government', is that a statement about political science, rather than two-party govt system with lots of lobbying? I mean it seems like any policy you could concoct would benefit some (posibly small) interest-group of people somewhere, unless it was 100% wasteful.
[0]: https://www.investopedia.com/ask/answers/041315/how-principl...
> Our interests are not served by solving problems without oversight, as GP suggests.
Sure, that's a given. But many of us think the oversight is working on our behalf, yet isn't. (Compare e.g. the sham of the TikTok oversight hearings vs the not-very-effective Facebook ones.)
[0]: https://www.politico.com/newsletters/weekly-score/2023/02/27...
Hmmm, I wonder how hard it’d be to lawyer up and force Clearview (and OpenAI?) under GDPR (or CCPA?) to remove every piece of personally identifying information about me?
Clearview: “We have a 99.7% certainly match for the Zodiac Killer. The name is [deleted as per GDPR request] and the link to their mugshot photo is 410 Gone. Deleted as per GDPR request”
I wonder how low a resolution in facial keypoints you would have to go to have any plausible claim that the data is no longer PII?
“We don’t have any PII as covered by the GDPR. We do however have this list of 15 xy coordinates here, that coincidentally happen to match up with the output of a facial keypoints that might be generated if somebody _else_ had a photo of you and ran it through a keypoints extraction algorithm…”
I’d probably take a day off to do some justice tourism and visit the courtroom the day a lawyer for Clearview tried to argue “My clients product, which they sell as a method of personally identifying individuals, does not store any personally identifying data for individuals it identifies, your honor.”
It doesn't matter how low the matching resolution is, they still need to store the whole image somewhere to show the match and that is 100% personal information
It would be nice, of course, if a good Qualified Immunity case hit our current SCOTUS. They may rule differently than past courts, if they're as principled as they purport to be.
They can also claim their technology does not make an accusation, it provides a similarity score that LEO can use in their investigations. This is also supported by the facts: sheriff’s officer insisted it was a "positive match".
The sheriff's officer actually gives up the game here, revealing they improperly relied on the similarity score to deduce a suspects guilt, but an actually competent prosecutor would know better. The fault lies with the LEO in this case. Good luck suing them.
https://en.wikipedia.org/wiki/Dragnet_(policing)
Since the 1950s, such "dragnets" have generally been held to be unconstitutional as unreasonable search and seizure actions.
Related: https://en.wikipedia.org/wiki/Reverse_search_warrant
Certainly. If a box outputs "this, M, is the best matching I have to A", it takes a sloppy fool to entail that "M is A".
If an OCR says that it sees some specific characters, that is not a "certainty obligation" - it is just a "best effort" through reasonable algorithms and imperfect data.
You are obliged to check. The fact that some people - and workers, and with responsibility - can be confused on those basics shows the urgency on rebuilding "common sense", a civic upgrade to "good sense", in society.
But I must admit, facial recognition instantaneously brings millions of faces onto the suspect list that never would have been considered. Two chances increase: the chance of finding the true suspect and the chance of finding an unfortunate look-alike.
Of course. This is confusion between tool and worker. It is not very far from leaving a screwdriver near the wood planks and expecting to find the cupboard built.
It's also worth noting that this company has been criticized many times in the past, but nothing has changed.
https://www.nytimes.com/2020/01/18/technology/clearview-priv...
Clearview AI is providing a service in good faith like all these other things. It's up to the police and courts to use that information correctly.
Furthermore notice that this guy was only arrested, and the evidence bar for arrest is lower than sentencing. I don't think we can even say the system malfunctioned here actually. He was arrested because it seemed probable he did it. That's how it's supposed to work.
Then he was released and should be given routine compensation for being arrested and turning out to be innocent.
It's the police that need to do the investigation to make sure the guy arrested is the same person on the video. But then they could say too, "Well CVAI said it was a near certainty -- we just took their word for it! It would have wasted the taxpayers money to do a more thorough investigation -- afterall there's always some implicit uncertainty in standard policework!"
I think a more interesting question is something like: Does Clearview AI fudge their accuracy numbers? Would the true 80% likelihood of you being the perp be more or less slanderous than a 99% likelihood?
Which is itself a bit of a problem, as having an arrest on your record, even in the absence of a conviction, a trial, or even if you were found innocent, is rather damaging. It adversely impacts your ability to rent housing, for instance, or get certain jobs.
Put it this way, traditionally in the US, the people who would challenge this state of affairs fall mainly within a certain group that has historically occupied the lower part of our "societal power hierarchy". Conveniently, this sort of "mistake", tends to happen to people belonging to that same group far more often than it happens to others. Which saddles that group with the problems outlined in the comment we're discussing. It also saddles them with the concomitant consequences with respect to their ability to advance in society. (Since they can get neither a good job nor a good place to live after their arrest.) That they were innocent is a nuisance to the system, not really a deterrent to the system. Certainly not a reason to change the system in the eyes of a lot of Americans.
And this sort of thing is state law, so it would have to be changed in each state.
Also there are lots of scummy private companies that collect this info for background checks. Really scummy ones will offer to remove that arrest for a fee.
In the US (or at least in my state), I believe that arrest records and criminal histories are public information.
Interestingly, if you are convicted of a nonviolent crime, it's not usual for that crime to be expunged if you did everything you were supposed to do (restitution, stay out of trouble, etc.) If that happens, then the conviction isn't in the records at all anymore -- but your arrest record still is.
Every technique you listed have problems that prevents them from deciding in good faith if there is a match. Sometimes we can find out probability of match but most of the time even that is out of reach, we just don't know.
Clearly the AI is more intelligent than the police officers using it and this needs to be addressed in a transparent way to allow for mistakes to be discovered faster. Transparency was absolutely lacking in this case. Heck, everyone, from Clearview staff to the judge and officers involved in the arrest and the victim should have been told "this AI had a 99% match, do you want to challenge it?".
If you're commenting on something you don't understand, maybe don't start out with this?
> I'm pretty sure 'reckless disregard for the truth' would be pretty easy to prove in this case -- considering Clearview probably can't say specifically why this person selected for arrest.
Sigh
Reckless disregard for the truth is like still spreading lies, even though people around you are telling you otherwise, or even in the face of obvious reasons it is not true.
Here, they believed a computer program that was promoted as being accurate. An average person would probably have no reason to strongly doubt it, especially if it has been correct before. If they were acting with their best intentions, based in the “facts” they had before them, defamation would difficult to prove.
> If you're commenting on something you don't understand, maybe don't start out with this?
HN is gonna get pretty damned quiet if techbros can’t immediately mansplain their opinions to each other about things they have no clue about. (“But but but, I work for FAANG! I passed their stupid gatekeeping recruitment quizzes! I’m _clearly_ the smartest guy in the room! Now, let me tell you all about epidemiology and airborne virus transmission. What? No, I studied CompSci not any of those boring soft sciences like medicine or biology. Anyway, what we need to do is…”).
;-)
You're missing several things here, so let's break it down.
The first, and most important thing, is that a defamatory statement must be a false statement of fact in a nonprivileged context. While "false" is easy to understand (especially given that any nitpicking gets filed under the intent bucket), "statement of fact" is a confusing thing that's basically half the lecture on defamation by itself. But one of the things that expressly isn't such a "statement of fact" is a conclusion based on disclosed facts (even if the logical reasoning used to support the conclusion is fallacious). It's also worth noting that statements in some contexts can never be defamatory--for example, legal pleadings can never be defamatory (but press conferences about legal pleadings can be!).
As we apply that to this situation, I strongly doubt that any statement is actually defamatory. We don't know what the company messaged to the police department, but based on the quotation from the affidavit for the arrest warrant, the message probably was along the lines of "facial ID on this surveillance footage matched this person" (which is a true statement of fact), and any statement that moves to a conclusion that said person committed the crime would fall into the "conclusion based on disclosed fact" non-actionable statement. Furthermore, it's possible (I'd have to look up jurisprudence here) that the statement to the police officer is a context in which nothing can be defamatory.
The second thing to point out here is the requisite intent. As the person in question is not a public figure, the standard here is actually merely negligence--the person making the defamatory statement essentially has to be in a position where they could have discovered that the statement was false with reasonable efforts that they failed to undertake.
While it's not relevant to this case, your notion of reckless disregard is incorrect. In defamation contexts, "reckless disregard" means "entertained serious doubts of the truth of the statement." I can't really envision a plausible scenario where you could show that Clearview AI meets "reckless disregard"; even an email thread where developers talk about the false positive rate being tuned too damn high likely wouldn't qualify since it's not specifically about any individual statement they send out.
The final point to make is that the burden of proof of all of this in US defamation cases is on the plaintiff. Even in the initial complaint, the plaintiff has to allege facts with some degree of specificity (and plausibility) to show that the defendant had the requisite level of intent (be it negligence or actual malice). But before all that, the actual defamatory statement needs to be alleged... and notice that we don't even know what Clearview AI told the police department. This case is very far from a slam dunk, so far that I would be very worried about facing an Anti-SLAPP motion (which would mean having to pay the defendant's attorneys as well as my own should I lose) on filing it were I the plaintiff.
https://popehat.substack.com/p/can-a-tarot-card-reading-be-d...
I mean, it's not the tool, but the user of that tool that should take responsibility. As I remember, they must be instructed that this is not a silver bullet and may make mistakes.
So, yeah, a bigoted cop can pull over minorities and trivially manufacture some rational reason that will justify their actions. There's always a "reason".
"People get arrested on false pretenses since the invention of police" feels like an overly reductionist response to stories scrutinizing technology
The "evidence" would not exist if Clearview AI (or any similar vendor) did not purport to offer a reliable matching algorithm and expansive dataset. It's not as if the police randomly picked out someone to frame, and then used software to fabricate evidence for the warrant.
> “The guy had big arms, and my client doesn’t,” Mr. Calogero said. A Jefferson Parish sheriff’s officer insisted it was a “positive match,” language that made Mr. Calogero believe that facial recognition technology had been used, and he spoke to the New Orleans news outlet NOLA.com about what he believed had happened.
The man's lawyer says he (the client) looks like the suspected thief in surveillance footage. How is that "random"? How would the wrongly suspected man have even been known to the police without the use of Clearview's database and matching algorithm?
A hundred years ago there was a real cost in time and effort and interpersonal relationships to get a judge to sign off on a warrant at a weird hour. Are the reductions of those costs brought about by using technology in this way a net win for society?
The policeman in this actual case did something wrong. Did he, out of a motivation to increase his arrest record, find a random black man across state lines to try and arrest? Did he, out of malice, choose to target this person? Did he, out of laziness, not look too closely at two pictures side-by-side and click a "Request Warrant" button? How easy, exactly, is this mistake to make? That question only makes sense because of the technology in the story.
Fine, yes, this is a police-made-up-evidence story. But its also a technology-enabled-a-psuedo-scientific-confidence-interval-to-make-the-made-up-evidence-more-convincing story. Dismissing it out of hand really downplays why facial recognition (or algorithmically generated feeds or the banning of human content moderation or...) is so fraught. There may well be a solution to the problems appearing, but we're not going to arrive at those solutions without discussing those problems as, well, problems.
The friction of getting a warrant has been eased by technology. The Jefferson Parish Sheriff’s Office uses an “eWarrant” service, CloudGavel, for which it paid $39,800 last year. It’s an app that allows officers to request digital signatures from judges. “Law enforcement officers can now get an arrest warrant approved in minutes,” the company’s website states.
Many civil liberties advocates actually favor electronic warrants; they allow judges to more easily review decisions made by the police and eliminate a complaint from officers that it’s too hard to get a warrant. But advocates said it would be worrisome if judges were simply clicking a button without asking questions or providing sufficient scrutiny.
“There are real questions about whether it increases the incidence of judges rubber-stamping warrants,” said Nathan Freed Wessler, a deputy director with the A.C.L.U.’s Speech, Privacy and Technology Project.
Much easier for EU and California residents
That's not an opt-out. That's only a request that they remove the index to an image that has already been removed from the web. You can't ask them to remove all photos of you, nor will they remove a photo that is still up on the web.
In other words, it's the sort of bullshit that we can expect from an evil company like ClearView.
So even the meagre facility they offer here is completely meaningless.
So.. yeah.
https://drafts.csswg.org/mediaqueries-5/#prefers-color-schem...
"Are you a California resident or are you authorized to submit this request by a California resident and submitting this request on behalf of that California resident?"
There's no language stating the photo needs to be of a resident of California. So could I just call up my friend in LA and say "hey is it cool if I request Clearview to delete me from their database on your behalf?"
lol. lmao.
The judge approved the arrest warrant on the basis of AI alone.
And people want to blame Clearview? Why?
Do you actually care about wrongful arrests? Because when you take Clearview out of the picture, you still have these incompetent or overworked human beings cutting corners, arresting people, and having those people take a plea deals because they don't have money for lawyers so they can make their numbers and get whatever incentive they are chasing.
What the *%#€!?
Excerpt:
> His parents made phone calls, hired lawyers and spent thousands of dollars to figure out why the police thought he was responsible for the crime, eventually discovering it was because Mr. Reid bore a resemblance to a suspect who had been recorded by a surveillance camera. The case eventually fell apart and the warrants were recalled, but only after Mr. Reid spent six days in jail and missed a week of work.
> Mr. Reid’s wrongful arrest appears to be the result of a cascade of technologies — beginning with a bad facial recognition match — that are intended to make policing more effective and efficient but can also make it far too easy to apprehend the wrong person for a crime. None of the technologies are mentioned in official documents, and Mr. Reid was not told exactly why he had been arrested, a typical but troubling practice, according to legal experts and public defenders.
Unofficial documents are produced by official not using standard procedures in any variety of ways (searching a private company's database in this instance). Generally, doing this is against the regulations of a bureaucracy. But American police view themselves and often treated as above regulations, even their own regulations. So American police often produce and keep unofficial documents with no consequences.
This statement is clearly false.
As evidenced by
> and Mr. Reid was not told exactly why he had been arrested
Malfeasance is the cause, the level of which should result in prison sentences for the police who made the decision to deprive a person of their freedom and more for a week.
Edit: wow, OK, things beyond even me.
It might be absurd, but it is common practice.
California recently had a gang round-up where warrants that were provided as the basis for searches for properties in question had almost all information needed to verify the validity of the warrant redacted (even the address for the property in question being presented at, at least according to local news).
No one had any idea what was going on or whether the warrants were even legitimate, seemed like a play out of East Germany's playbook before the wall came down, just short of the gestapo.
Also, if there is a warrant, they generally have to show it to you.
When a person is charged with a crime, the police expected to supply evidence but they can come up with excuses not to. Once the case goes to trial, all the evidence is supposed to be available to defense attorneys. But since plea bargaining is common, police may not have to come up with the evidence ever.
Overall, US legal procedure is full of things that are absolute rules for civilians but just sloppy average suggestions for cops.
The article is effectively saying "(accepting as a given that police charge and arrest people on entirely ad-hoc, hence lawless grounds...), Mr. Reid’s wrongful arrest appears to be the result of a cascade of technologies". But naturally we shouldn't let that just go by.