I have a lot to say about Signal’s Cellebrite hack
cyberlaw.stanford.edu
cyberlaw.stanford.edu
I just can’t work up the ability to sympathize with Cellebrite. The law may have something to say about Moxie’s writing, but in my opinion he has the clear ethical upper ground in this argument.
> If you work at Cellebrite, on the other hand: get down off your high horse, stop it with the “we’re the good guys” shtick, quit selling to authoritarian governments, and for god’s sake, fix your shit.
> Giving defense attorneys more ammo to push back harder against the use of Cellebrite devices against their clients is Good and Right and Just. The general point that Moxie made — Cellebrite’s tools are buggy A.F. and can be exploited in ways that undermine the reliability of their reports and extractions as evidence, which is the entire point of their existence — is actually more important than the specifics of this exploit
You're kind of missing the point of the article. The article agrees with you that Signal's hack was a net positive and Cellebrite is not a good company.
I also disagree with the notion that it’s good that Cellebrite exists because without them we’d have stronger anti-encryption laws. That’s hypothetical and all we know is what we have today. I’m not thrilled that someone is peeing on my basement carpet instead of peeing in my living room; I’d rather not have someone peeing on any of my rugs.
- The threat is likelier to annoy judges than garner sympathy
- Following through on it is probably illegal
- Worse, following through could put their users in legal (and/or physical) jeopardy
- More generally, Signal should consult with lawyers before doing things like this
This bit is very relevant, and I agree. It’s ethically dubious to put unknowing users at risk in that way, whether from democratic or authoritarian governments.
The other points, though, very much assume that the goal is to change the outcomes of American court processes. The focus is almost entirely on what a judge in the US would think, on evidence rules in American courts, etc. Maybe American law and law enforcement isn’t as relevant as an American lawyer thinks it is, and Signal is betting that the PR and politics game is more important.
If they did make that bet, which I think is likely, then the article has some valid arguments at the end – this hack(or non-hack) may lead politicians to introduce stronger laws – and _that’s_ where the focus should be. Is this a god move, politically?
And, to reiterate from the beginning: Does this put end users in danger? If it does, it’s likely not worth the price even if there was some political victory in the end.
I'm curious how? If they announce publicly that they will place files on devices that may exploit a publicly announced vulnerability in Cellebrite, then it's Cellebrite's prerogative to fix the vulnerability. If they knowingly ignore a publicly disclosed risk, then they have only themselves to blame.
>Uh, is that legal?
>No, intentionally spoiling evidence — or “spoliating,” to use the legal term — is definitely not legal.
>Neither is hacking somebody’s computer, which is what Signal’s blog post is saying a “real exploit payload” could do. It said, “a real exploit payload would likely seek to undetectably alter previous reports, compromise the integrity of future reports (perhaps at random!), or exfiltrate data from the Cellebrite machine.” All of those things are a violation of the federal anti-hacking law known as the Computer Fraud and Abuse Act, or CFAA, and probably also of many state-law versions of the CFAA. (If the computer belongs to a federal law enforcement agency, it’s definitely a CFAA violation. If it’s a state, local, or tribal government law enforcement agency, then, because of how the CFAA defines “protected computers” covered by the Act, it might depend on whether the Windows machine that’s used for Cellebrite extractions is connected to the internet or not. That machine should be segmented apart from the rest of the police department’s network, but if it has an internet connection, the CFAA applies. And even if it doesn’t, I bet there are other ways of easily satisfying the “protected computer” definition.)
What's the principle being applied here? How would the same principle be applied in the case of digital property?
Difficult philosophical questions arise with the phrases “knowingly causes” and “intentionally causes damage,” but a jury can use common sense to resolve them on the evidence in a particular case. The same issues arise when trying to determine intent and causation when someone fires a gun or carries a bag full of white powder. The details matter.
The author also misses the point of the "show me yours I'll show you mine". Cellebrite is, from what I understand, knowingly leaving everyone's machine vulnerable in order to conduct their business.'
This is something that _should_ be illegal. Not disclosing (and actively benefiting from) vulnerabilities in other peoples products is what we should have laws against.
> An attacker need not directly send the required transmission to the victim computer in order to violate this statute. In one case, a defendant inserted malicious code into a software program he wrote to run on his employer's computer network. United States v. Sullivan, 40 Fed. Appx. 740 (4th Cir. 2002) (unpublished) [2]. After lying dormant for four months, the malicious code activated and downloaded certain other malicious code to several hundred employee handheld computers, making them unusable. Id. at 741. The court held that the defendant knowingly caused transmission of code in violation of the statute. Id. at 743.
The CFAA is notoriously broad, which is probably why Pfefferkorn didn’t feel the need to undertake a detailed analysis of exactly how it prohibits the deployment of a targeted exploit which would “undetectably alter previous reports, compromise the integrity of future reports (perhaps at random!), or exfiltrate data from the Cellebrite machine.”
[1] https://www.justice.gov/sites/default/files/criminal-ccips/l...
[2] https://www.anylaw.com/case/united-states-v-sullivan/fourth-...
What worries me most about this disclosure is the potential for abuse inside law enforcement agencies and departments . What if a evidence gathering machine is deliberately not patched against this e exploit?
If I sold software like Cellebrite I would have at least attempted to make enforceable the cessation of licenses for any out of date instalation.
What really confuses me is why vendors like Cellebrite don't have a commercial case for at least some level of independent testing of their wares in order to provide a limited warranty for the operation and results.
Until now I actually thought it was necessary to obtain suchlike independent testing and make appropriate assurances to LEO to be able to legally sell such software in the first place.
Article concludes the uneasy status quo permits all parties to do their best work respectively. Unmentioned is that that at least pays lip service to the American Way of meriticracy and endeavour and the ideal ultimate effect of fairness to all.
ThIs is probably my naivety again ; but why can't laws prohibiting the use of 0Days exploitation work to the advantage of the law and society and commerce alike?
If zero day exploits had to be disclosed to a central independent organisation (comprised of members from LEO and civilian life and working on a mandatory equal resources footing to enable citizen participants without any need for corporate sponsorship) and there was a definite widow permitting the use of exploits ended with a mandatory tested patch release and public announcement, I don't see how it would be unfair or the unreasonable for anyone on either side of the law. I would even consider it isn't a bad thing to disclose vulns identified by software engineering and not discovered publicly, to be notified to federal agencies when identified. I actually think that we should do this already for the protection of our diplomats and overseas representatives.
Since we already have the instrumentation to selectively patch individual devices in widespread use, why cannot agencies request the exception of devices under surveillance to enable the security of the general public?
I realise this doesn't work for covert and unlawful intercepts. And there do exist reasons for covert intercepts to be carried out. However every advanced society should be pushing such incidents to the margins with every available force possible.
Security experts are worried about this argument because the global security of the USA is increasingly and credibly threatened. Show me how a well designed infrastructure for the protection of the innocent from unwarranted invasion, how I've outlined here, can possibly be a negative for law enforcement and national security and I'll eat my hat : the suggestions I'm making entirely reinforce the accessibility of intercept capabilities for lawful deployment and instrumentation for device specific code patching only enhances the potential for positive acquisition of intelligence on criminals and foreign agents. The USA should be peeling back the layers of the baseband implementations of 5G and immediately order the decommissioning of all 2G installations that are trivial to abuse.
The faster the USA creates a viable OSS 5G RAN code base the faster foreign potentially hostile competition is disabled in the race for budget handsets and deployment.
The number of people who have any interest in this field is small enough for background checks to not be prohibitive to open source goals. However serious consideration needs to be given to any blanket release to higher education institutions because the number of overseas students is simply too great to rule out hostile intentions.
Along the similar lines we need to undo academic publishing holds on legitimate interest interest in research. Because only hostile nations are served by making the distributors of publicly funded research available to the public.
I mentioned that last point because I think the most important argument of the article was about the blurring of the lines where actually really sensitive concerns do exist on the national basis that are being trivialized by a leading vendor of personal privacy communication software touting hacks in the way the author explained he found unbecoming and - unspoken but clear to me at least - dangerous to society as a whole.
Last year I implemented so called "content protection" software for my company which enables the restriction of eg sending emails with sensitive words included. Or the attachment of files. And in depth classification and full text inspection tools and services. This is a growth market right now and I would strongly encourage anyone wanting interesting and well paid consulting work to study this area and particularly spend time for looking at how many new entrants are appearing constantly. My company doesn't expect to see much benefits from this expensive software installation, but the purpose we have is to use the obtained metadata for eg graph database analysis for assisting with our own research and development of opportunities from customer provided documentation and research. We're planning on linking back to raw incorporation filing feeds on individual parties and even public LinkedIn posts and comments.
I'm mentioning that because the value of captured surveillance data in the raw becomes massively more potent information combined with the associated network of correspondents and individual sources and references.
At one time when I was young I thought the cost for academic research papers was the cost of government surveillance of interested parties obtaining advanced insights into technology and analysis and systems.
The software my company purchased is in theory capable of tracking the lifetime of a document that has been passed through any number of hands.
Obviously it's trivial to air gap your reading device. But consider the volume of individual papers and documents you consume in any given year and certainly for the hn crowd that's likely a large number.
Make it difficult for criminals to conceal the pathway taken up to their own devices by a very large number of information sources and the resulting black hole is a hypothetical perfect telltale snitch.
Conversely, it's perfectly possible to enable free acquisition of research documents by a intermediary for the consumption of a legitimate researcher or team. I have worked for 30 years in specialist publishing in industry association members journals paid for by advertising. The Internet allegedly destroyed the viability of my business. What did happen was advertising agencies suddenly declared print media dead and ceased operations in my field almost in choreographed unanimity. This was 25 years ago. I actually think that it was my field that Google was interested in when they declared reported in Advertising Age and other trade media to have, along with a consortium of the biggest publishing houses, that their multi year and multiple hundreds of millions of dollars project for trading printed advertising online had failed and mentioned that particular obstacles included the very problems my company overcame just to start trading in 96. I don't think Google wanted to help anyone sell consumer targeted advertising. They almost certainly even in 04 knew that would be their market to themselves. But highly vertical advertising within industry niches where what's being advertised often is incomprehensible without accompanying features commissioned by the publication to cover a niche within a niche and attract everyone in that market as advertisers. Take 200 thousand times 4 for quarterly issues and 50 thousand average readers by name times 4 a low "reach" estimate gives 1.6*10^11 pairs of eyeballs per year in this forgotten and buried business.
That's who will be only too happy to bear the infrastructure costs of the document management system necessary for a truly global scale tracking of research dissemination.
Don't dismiss this immediately only for concerns about privacy : this couldn't fly without a way to give real privacy for the protection of researchers needing to avoid any giveaway of their direction and interests. Legally double blind intermediary agents as proxies are far from trouble to implement and I know that demand exists for such a proxy among some customers of ours for a additional layer of privacy and discretion for their work.
We've almost forgotten because of the global economy how much the USA and critical input from other western nations is advanced compared to the row. I personally think that the expansion of university campus facilities has been happening because of foreign students demand and potentially profits from them assuming that zero interest rates continue until the debts are paid and assuming that that happens before the lifetime expectancy of the buildings erected creates a financial noose around higher educations head. The borrowing I've looked at doesn't have principal repayment horizons early enough by a very long way.
Such expansion of a surveillance of research rrs
Also, if you know someone is stealing your lunch from the shared work fridge, so you add rat poison to your lunch, do you get to walk away scot free on the theory that it’s the thief’s fault?
Let's look at another case, I remember that some people had USB drivers that detected "wrigglers" and shut down the computer in response to such a wiggler. Would that also be illegal?
If I install anti scan files and anti mouse wrigglers when travelling to China do they become legal then?
Presumption of innocence is the most fundamental cornerstone of common law.
Similarly, if your app/device damages government property and tampers with legal evidence, both you and the creators would likely be held responsible. Even if the law may be unclear, you will definitely face charges for this, given how defensive police departments are in these cases (there was one case where a person they beat up had extra charges brought against him for dirtying the officers' uniforms with his blood... ).
Furthermore, simply creating exploit code and releasing it into the wild is illegal, so Signal, if it were ever found to have done what they let us believe they could do, could be held legally responsible, even if the code never made it to exploit a live system at all.
You definitely are not allowed to have traps in your house with the intention of hurting potential thieves. So definitely no bear traps etc.
Permanent ink would probably still fall under that category. And below that it becomes grey area.
My point is Cellebrite/the Cellebrite user would be the one spoiling the evidence. The evidence is sitting there on the device unspoiled, and only if the user decides to charge ahead without heeding the public warning that doing so without the necessary precautions will spoil the evidence will the evidence actually be spoiled.
Signal itself has no knowledge of which files constitute evidence (it applies this completely indiscriminately), so I don't think you could argue that it is knowingly spoiling evidence.
The article, written by a legal scholar with a specialty in precisely these issues, directly contradicts this.
Signal coyly threatened to make their app hack Cellebrite machines with the intent of spoiling evidence. It doesn't matter that they aren't targeting specific evidence. Blanket spoiling all Cellebrite evidence would apparently be enough to get them in legal trouble.
I'm having a hard time imagining this being a viable argument. Seems like the vendor should just fix their software if they expect it to work reliably. Anything else would be too large of a transgression on civil freedom.
Since Signal would be deploying that exploit to millions of devices to combat surveillance tech, I would expect that to at least result in a suit even if they were able to defend themselves successfully. It would be especially interesting to see how Cellebrite’s use by various repressive regimes entered into that: an American court might, for example, be sympathetic to a campaign trying to protect dissidents in China which happens to impact an American police agency using the same tool.
Doesn't mean it isn't net positive, just means the details of how they did it were... maybe not the cleverest. But who knows, one person's opinion, etc.
And that’s not for (American) lawyers and judges to decide against, its for politicians in all democratic countries:)
Note that this is one of many, many reasons it’s unlikely that I’ll ever be appointed Lord Emperor.
Cellebrite, as I recall hearing (Or was it StingRay?) have pretty strict non-disclosure license terms; I doubt Cellebrite knowingly sold one to Moxie.
I would be interested in seeing this go in front of a court because Signal isn't directly targeting any specific person, and the files are fine until they are processed through a specific broken pipeline.
If I put a fake USB port on my phone that was a USB zapper to kill the device it's connected to, it would not be illegal and it would be on the people seizing my phone to take responsibility for it. You cannot repackage vulnerabilities for police and then turn around and play coy because you're not able to keep your software up to date.
In the defense attorney section, the argument shouldn't be about the PoC but the fact that the PoC shows that Cellebrite's software is outdated and could be compromised. You can specifically ask for the backup that was extracted from the mobile device to be analyzed by third party software.
1) Cellebrite has to interface with software to do extract data. 2) Signal is the software in some scenarios. 3) Signal can alter itself so that if Cellebrite interfaces with it, Cellebrite breaks. 4) If Cellebrite doesn't interface with Signal, Cellebrite is fine, Signal is fine, and no one is hacked.
If I trespass on someone's property, and they have a booby trap that blows my leg off, I believe in most US jurisdictions, I can take them to court and have a good chance of winning.
Isn't this the same type of thing?
On the other hand. If I have a guard dog, and a bunch of "Beware of Dog" signs, and someone trespasses on my property, and the dog attacks them, I don't believe I'm liable. So by publishing this information, has Signal avoided the important nuance of being a trap?
"I have Signal installed on my phone" seems a reasonable disclosure of a known potential trap.
If a police officer chooses to scan said phone with Cellebrite, it feels reasonable that you have discharged your knowledge to the extent possible.
No, that's a straightforward statement of fact which a software expert might realize implies there's a trap. A police officer could not reasonably be expected to know that.
A reasonable disclosure of a known potential trap is
"I have Signal installed on my phone, so if you use a Cellebrite device to pull my data your Cellebrite device might get hacked by Signal."
If you're using Signal at all, you probably care at least a little about security, so it's not a given, but probably the vast majority of Signal users wil never hear about this.
I wasn't trying to say you're automatically guilty if you don't warn the police about what Signal could do.
I was just trying to say that a statement that _implies_ a trap exists, if you know enough about a piece of software, it's not a reasonable warning that a trap exists.
If you know the trap exists, a case can be made that such an indirect statement is actually baiting the trap, rather than warning about it.
It’s not just cops that use this software. Bad foreign actors do. Private investigators might. Hell, Signal demonstrated that they’re falling off trucks, maybe you want to protect yourself from Moxie!
In the San Bernadino iPhone case there was a lot of hand-wringing about Apple's password limits, but no one was accusing Apple of purposefully destroying evidence because it has a setting that wipes data after multiple failed login attempts.
Cellebrite does not only sell its software to the US government; one of its chief criticisms is that it doesn't really care who gets its code. So the threat model to end-users is the same, the same fears that would make me want to wipe my phone if someone is trying to get into it might make me want to wipe my phone if someone is trying to automatically pull large amounts of data off of it.
Is the worry here that Cellebrite's vulnerability would need to be executed on a different computer, so it's in a different category? Forget technicalities and cleverness, I don't understand even the basic logical difference between Signal destroying its own data on export and iPhones wiping their data after failed login attempts. I trust the author, but I just don't get it. What security measures are acceptable to build into software?
Yes, possibly. The legal system is all about trying to establish clear lines dividing the spectrum of obviously OK behavior and obviously unacceptable behavior. It is obviously OK to delete text messages off your phone. It is obviously unacceptable to break into a police station and delete evidence off their computers. Somewhere in between is the dividing line, and if this went before a judge it is entirely plausible that they would draw the line there.
That’s because the feature is designed to protect your data and phone after it’s been stolen by a criminal, not to destroy evidence lawfully sought by law enforcement.
But Apple's encryption does still destroy evidence lawfully sought by law enforcement. And in fact, Apple has gone out of its way to make sure that its encryption will still destroy evidence even in instances where law enforcement is trying to access it -- that was the entire controversy behind the San Bernadino case.
Apple wasn't willing to put holes in its security even knowing that their position made it harder for police officers to execute a lawful warrant.
> is designed to protect your data and phone after it’s been stolen by a criminal
I think I already talked about this above:
> Cellebrite does not only sell its software to the US government; one of its chief criticisms is that it doesn't really care who gets its code. So the threat model to end-users is the same, the same fears that would make me want to wipe my phone if someone is trying to get into it might make me want to wipe my phone if someone is trying to automatically pull large amounts of data off of it.
It's not clear to me that the threat model from Cellebrite is different than the threat model from a criminal. Cellebrite does not exclusively sell its software to the US government. And if Signal's devs could get their hands on it then there's no reason to believe that criminals couldn't get their hands on it as well. We already know their software has been leaked outside of law enforcement, because Moxie has it right now.
I'm not saying that the author is wrong, I believe them. And I can understand that exploiting a vulnerability might be treated differently than on-device data deletion. But the specific reasoning you give about intent to disrupt an investigation makes no sense to me. In both cases I'm defending against criminals who may have stolen my phone and may be trying to exfiltrate data. The police aren't who I'm worried about here.
It's not even that Apple/Signal's threat model seem to be 'technically' the same tunder some kind of narrow criteria or letter of the law, they're basically identical. As a layperson on the street or as a programmer trying to build secure software, I don't know how I would tell the two threat models apart. I don't know what test I can use here to tell when I am and am not allowed to be afraid of criminals stealing my phone and data.
The fact that evidence is destroyed even though it is lawfully sought by law enforcement can be, as attorneys would say, incidental. The same goes for people like me who regularly shred documents. I don't do it to frustrate law enforcement; I do it to frustrate identity thieves.
BTW, companies destroy what could be future evidence as a routine matter under the guise of data retention policies. Take, for example, a policy that all incoming and outgoing emails are expunged after 90 days to conserve space and help contain the damage caused by corporate espionage. Courts aren't going to hold companies accountable for willful destruction of evidence if some evidence they would have lawfully sought is gone due to the execution of the policy. However, if a company has been given notice that they are subject to a subsequent preservation order, they must suspend the policy to the extent needed to effectuate the warrant or subpoena to avoid getting into trouble.
> I don't know what test I can use here to tell when I am and am not allowed to be afraid of criminals stealing my phone and data.
That's why we hire attorneys! Legal counsel is here to help. Ain't nothing wrong with relying on subject matter experts. For the same reason, I hire people to crawl through my attics, too.
I guess this is what it would come down to (ignoring other liabilities like the CFAA): if Signal actually implemented their feature, would they be able to argue that their intent was to stop criminals abusing Cellebrite software, or would it be possible to argue that their intent was from the start to disrupt police investigations?
With Apple that's probably going to be hard to argue, they'll come out with some basic stats that talk about theft reduction, they'll point at their advertising and messaging around the feature.
I can see a distinction there, even though I don't see a super-clear reason to believe from Signal's one blog post that they're specifically trying to disrupt the police.
> That's why we hire attorneys! Legal counsel is here to help.
This is obviously good advice, and people shouldn't be looking at HN musings to figure out what is and isn't legal. But at the same time, minor sidenote:
I'm not angry at you, and this isn't anyone's fault in specific, but I low-key hate this answer because a metric ton of innovative software gets built by people who do not have the resources to hire attorneys for every decision that they make, and it's really unreasonable on a societal level to expect every Open Source dev, teenager, single-founder entrepreneur, etc... to have the resources to have legal counsel on hand. The majority of people in the US can't just go out and talk to a lawyer whenever they want.
Not really relevant to what we're talking about, and again, nothing to do with you, but I'm still unable to keep myself from ranting about that whenever this topic comes up.
However, there are explicit laws against tampering with evidence or things that you'd expect are likely become evidence.
No one is harmed but the tool being used to break in.
I say arguably of course as I doubt that this is a scenario that has really been carefully tested in law, but the article seemed more focused on how such an act would be interpreted by the courts if it really came to it. And the important part of such a situation is mentioned here:
"... (if the user gets blamed for what her phone does to a Cellebrite machine, she will be plunged into a world of pain, irrespective of whether she would ultimately be held culpable for the design of an app she had installed on her phone)... "
My layperson read of all this situation is that it doesn't really matter whether or not you know at the time of such a file existing whether or not you're under investigation, if the end effect the file will have on a process used by a Government Agency in a legal search is known, the fear seems to be that even if ultimately you end up inculpable, it's a very long and rocky road to get there legally speaking, as the Government will likely not even try to argue about the quality of code or whether it's you or Cellebrite (or whoever) that is responsible, but that you had a file which had a known effect which in turn impeded an investigation.
Remember that criminal cases have specific challenges that the prosecution accuses of and that the defendant protects against; if the challenge is that "[you] knowingly put data on your computer which impedes investigations by Agencies of the US Government by means of corrupting data", the mechanism of how the data got corrupted is not nearly as important as the actual act/intention.
If Signal really is doing this, I think their intent was trying to undermine this with the random users part (so that users couldn't feasible know if they had a trap or not), but personally, I think this is kind of weak as with the announcement, there's knowledge that an application you have has a non-0 chance of causing such disruption, and probably it's enough to at least waste a lot of your time and money. (Especially if it really did a number on a Cellebrite device that damaged a lot of other investigations...probably they'd go after a person just out of spite at that point.)
This results in an incredibly powerful tool landing in the prosecutions hands that can be used to quite literally drive a person to death by legal system while everyone non-technical has to be brought up to speed on how this stuff works and doesn't work.
Realistically speaking, I don't think the CFAA has actually been driven by real concerted attention from tge public. If it had been, I don't think the software industry would be anywhere near as big as it is, because when you really understand what you're doing when accepting a EULA, and then comparing that expectation with what programs actually do, there'd be an awful lot of software that actually falls under CFAA used for official purposes than anyone not in an official capacity would feel comfortable with; nevermind software for private use.
This file is targetted to damage LE property, it is hard to argue that they are random bytes.
If someone has a Cellebrite, they do not necessarily have a lawful right to access. Could just be a $16/hr Pinkerton (a wholly owned subsidiary of Securitas) using UFED on a phone they stole from an employee or contractor of the organization they contract with.
That being said - if it's all fine and dandy, I don't see why a Cellebrite-foiler couldn't be a separate app. Moxie (threatening to) piggy-back it onto Signal, purely because it's the app he controls, is a deeply user-hostile move.
I'm surprised Cellebrite allows for this. I would have assumed that the sales contract would include a "this is a lease, not a purchase" type of wording so that "you may not sale this device to anyone" with a buy back clause provided instead.
I have one at home but yeah, there's no EULA preventing you from selling something that's yours.
For a physical world analogy, let's suppose that someone gets shot, and you run away with the gun used and throw it into a river. Even if you'd be acquitted for the shooting itself (due to e.g. self-defence, or perhaps someone else did that shooting), you can be convicted for throwing the gun into the river as tampering with physical evidence, as hiding that gun is a crime by itself if the jury assumes that you did it so that it wouldn't get used as evidence. That applies even if there wasn't any warrant yet, as the investigation hadn't yet started; it's sufficient that you would have expected that this might get used as evidence.
However, I do think that in the case of a suspect having such a tamper proof safe, it would be a valid court order to require you to open that safe without destroying the contents. It's not really good to try and look for analogies with how similar or different something is to "providing a password" since providing a password itself is a boundary case between the right to not testify against yourself and the duty to provide the evidence so the specific case matters and in multiple cases people in USA have gotten jail time for refusing to provide passwords. Locked safes predate passwords, it's well-established that the contents of the safe are fair game with a warrant, so any analogies between safes and passwords are arguments that people should be required to disclose their passwords, not that people get to keep their safes unopened.
And if the safe did actually destroy its contents, they would charge you with tampering with evidence, and in addition to that, the prosecution might be allowed to assert as fact that the destroyed evidence did actually contain all the things harmful to your case that they intended to find there - the "spoliation inference" concept.
Also, your motivation for having such a safeguard matters. If a reasonable person would believe that you chose to use such a safeguard so that it would prevent police from getting to evidence and destroy it, that may be treated as a crime even if they manage to circumvent it and no evidence is destroyed. It's not about any specific method or process, taking any willful action with such an intent itself is a crime - you're not allowed to try to prevent a warrant from getting successfully executed.
Whether or not Signal is making a valid “safeguard” is an interesting question as you point out. I think you’d be on thin ice, but I’d be curious to see how that plays out in court.
I take issue with LEO overreach when it occurs and vendors shoveling garbage (paid for with tax dollars) to the justice system.
The courts forced a breathalyzer manufacturer to release their source code, so there is precedent for critical review of such tools.
That's falsely implicating 162 innocents of a felonius crime, tarnishing their future prospects for life, which reulted in plea bargains being accepted because the accused could not get sufficient legal representation to make the prospect of a successful legal defense doable, and a completely innocent of the charge individual didn't want to run the risk of amplification of sentence just for exercising a civil right. Besides being an example of why plea bargains make a mockery of our legal system; "just take this lesser charge that we don't have to really work at proving it so we can be done with it, because think of how bad the sentence will be if you make us work at it", it demonstrates that even procedures as they are now are such that an officer/prosecutor have and are willing to exploit their capability to manufacture suffering for those they serve for personal gain.
The System is getting shocked by it's vulnerability to the untrustworthy agent currently. So I wouldn't discount some fundamental reassessments of procedure down the road.
This will work the same way: if there’s corroborating evidence, it’s likely to be as futile as the original article’s author predicts, but if there is something speculative which has only unconfirmed evidence from Cellebrite it might be enough to get that thrown out.
That's a very important part of "innocent till proven guilty".
Your suggestion flips this around, thus leading to "guilty till proven innocent". Perhaps that is how things stand in practice in the USA. I don't think that that is how things should be.
As a logical extreme example, you are suggesting that courts forbid eyewitness testimony, since it’s always possible that they are mistaken or lying.
If the tool doesn’t “adhere to application security best practices” then the evidence is compromised and unreliable. Take a wild guess at how many states and other well-funded actors have been quietly deploying their anti-Cellebrite defences in the wild until Signal has made theirs public. If Signal was able to obtain Cellebrite, what is the chance they weren’t?
The problem is, they wrote this article. Where they say they will put 'aesthetically pleasing' code on installations. But not all installations. So Cellebrite can claim it's a menace (sort of a booby-trap) , and not a protection (sort of a shield).
Another issue: they say they obtained then kit because it fell of a truck. Any judge knows that 'fell of a truck' is a manner of speaking. Thanks to their statement it will be possible for Cellebrite to say "We checked the last 6 months of deliveries, no truck incidents". Cellebrite can try to find civil statutes (fraud?) and ask for discovery. If that is allowed by the judge, Signal will have to show all documents and messages pertaining to the hack, or risk contempt of court or perjury.
This is what the article is about. TL;DR: great work guys, wish you had consulted a lawyer before writing the post though.
LEOs are far from the only buyers of this hardware, a good chunk of Cellebrites userbase operate extrajudically and do not have a lawful right to attempt to access the contents of phones they use UFED on.
It absolutely is. This is the sort of "technically I didn't break the law!" nonsense that he explicitly called out in the article:
> Trying to find the edges of the law using technology will not make a judge, or prosecutors for that matter, shrug and throw up their hands and say “Wow, that’s so clever! You sure got us.” They won’t reward your cleverness with reddit coins and upvotes and retweets. They will throw the book at you.
When case law can take an inch given in statute, and turn it into a mile or a femtometer, you have a problem.
"(A)knowingly causes the transmission of a program, information, code, or command, and as a result of such conduct, intentionally causes damage without authorization, to a protected computer;"
if Signal downloaded Cellebrite-pwning shellcode to its app, that shows intent.. it's "knowingly causing transmission" in the sense that worm authors knowingly cause transmission of their viruses by equipping them with exploits (and are thus responsible for damage wherever the worm goes.)
if that shellcode does anything at all - deleting files, adding files, bricking the device, that falls under the CFAA's definition of "damage," since it affects the integrity of the extracted files.
you could argue that Signal doesn't knowingly intend to infect "protected computers," but unless these updates are, say, geofenced to not hit the US, it'll be obvious to the court that they could anticipate government machines getting hit.
the smartest thing would be for Signal to follow through on delivering these files, but have them be cat pictures. troll Cellebrite and muddy the waters for prosecutors. no CFAA violation, but Cellebrite can't ever be sure (and prosecutors can't ever prove.)
The transmission in this legal context is the other way imo. Cellebrite's device is transmitting Signal data out, and Signal is not intentionally sending data to these devices.
The part of the statute we're talking about triggers when someone:
- knowingly causes the transmission of a program, information, code, or command
- and as a result of such conduct, intentionally causes damage without authorization to a protected computer
Notice: this didn't require someone to transmit code to the victim machine: they knowingly cause code to be transmitted somewhere, and that intentionally causes damage as a result. Isn't that what you have here? In our assumed world, Signal's devs have written the app to pull down the exploit to the users' phones, thereby knowingly causing it to be transmitted. I think it'd be hard to claim with a straight face that your Cellebrite-targeting code (that you told the world about) wasn't intentionally targeting Cellebrite.
Under your rule of "you have to intentionally send data to the victim device," what result if you write malware and post it, say, on Facebook: just as you intended, anyone who clicks is infected, but the payload is inert as to Facebook's servers. Are you in the clear because the harmed users all initiated the download themselves?
On the other hand, in the hypothetical scenario where this actually happened and damaged some law-enforcement-owned machines, I don't see the average jury being too sympathetic.
It's certainly problematic enough that it's a legitimate concern, I'd say.
- Signal transmits a code (exploit) and keeps it in its cache, the code is dormant, nothing is being damaged here, it could stay like this forever, no harm.
- Cellebrite transmits Signal's files and cache, including the exploit, and gets hacked by reading it with their scanner.
The key is that the first action is harmless, and the second action is performed by Cellebrite, so can't blame Signal for it. I don't think these two actions can be consider as one.
And the main difference from the malware scenario is that this Signal code is not meant for reading, it is inaccessible and harmless for anyone except the Cellebrite hackers. The exploit is activated by unauthorized use, unlike the malware.
You don’t get to say “well you shouldn’t have been there”
For example, you can have barbed or razor-wire fences, its obviously barbed, its your fault if you climb up it and get impaled.
They advertised this, it's not hidden, so even if trap laws governed it (which they don't because its not hurting a person), it's not a trap.
Judges aren't machines, that slavishly follow any tenuous reasoning. They're judging; it's in the name. Specifically, they have to judge your intent. In many cases American criminal law requires a 'mens rea', or 'guilty mind'
‘If I put a bunch of laxatives on my sandwich to give the office sandwich thief violent diarrhea, it would not be illegal and it would be on the people stealing my food to take responsibility for it.’
This is the analogy that comes to mind which I’ve always heard to be illegal.
If the court (it's not that a laxative issue is likely to come to a full court, but still) believes that you did actually put laxatives in your drink because of your digestive issues, then that's legal, but if they get convinced that you did it with the intent to mess with your coworker, then the exact same action is illegal. In a smilar manner, if the court considers it plausible that you did just happen to have that file among various exploits that you store there for a specific reasonable purpose, then that would be legal, but it is illegal if the court considers it likely that you placed the exact same file there with the intent that it will destroy evidence - perhaps based on some other evidence, such as your online discussions on this topic and the timestamps of downloading and placing that file in relation to whatever other crime they are investigating.
Yes, there are many variables in play, but it doesn't make the problem undecidable, if it comes to court, your lawyer and the prosecution will point to them and the jury will decide.
This is what bugs me about common law. You can't take a statute at face value anymore once a sufficient amount of case law comes into the picture, and there is no active effort to reconcile the original statute with the reality of the case law it spawns.
(On the other hand, I feel like the zappy USB port may actually be easier to get away with, especially if you say your threat model was corporate spies or criminals trying to steal your password, because "violence against tools" does not seem to be put in the vigilante violence box. Those special materials they have for safe doors that are designed to damage angle grinders (https://www.newscientist.com/article/2249275-material-that-c...) are not illegal.)
The court follows the principle of clean hands. A thief is not going to have a compelling case against someone when they are throwing the first stone by stealing someone's sandwich. It's an interesting take, and I'd have to dive into actual case law to even determine if the test scenario is apocrypha or not. However, I doubt the laxative in sandwich argument would be compelling to a judge when there are much more relevant and easy to reach challenges to overcome.
-I.e. State mandated weakness to exploitation by Law Enforcement (You can't defend yourself from exploits used by Law Enforcement, which you are also not allowed to know about under Executive Privilege) -The ability of the Government to ensure their tooling meets chain of custody preserving standards Etc...
As usual, not a lawyer, just read a book on legal research and reasoning once.
I don't find HN threads where tech folk opine on what their opinion of how the law should be interpreted to be especially compelling either.
This is especially true here where I note that the author of the post folks are commenting on has an incredibly notable credentials and frankly it's somewhat ridiculous for lay-folk to be arguing with someone with such bone fides:
Riana [Pfefferkorn] was the Associate Director of Surveillance and Cybersecurity at the Stanford Center for Internet and Society. Prior to joining Stanford, Riana was an associate in the Internet Strategy & Litigation group at the law firm of Wilson Sonsini Goodrich & Rosati, where she worked on litigation and counseling matters involving online privacy, Internet intermediary liability, consumer protection, copyright, trademark, and trade secrets and was actively involved in the firm's pro bono program. Before that, Riana clerked for the Honorable Bruce J. McGiverin of the U.S. District Court for the District of Puerto Rico. She also interned during law school for the Honorable Stephen Reinhardt of the U.S. Court of Appeals for the Ninth Circuit. Riana earned her law degree from the University of Washington School of Law and her undergraduate degree from Whitman College."
It sounds like you're making an appeal to authority rather than an actual point about the article.
The discussion isn't about how a law is being interpreted. This blog article is about how the Signal article can be interpreted by a tech informed lay person vs a judge and the security theater surrounding it.
> Basically, “I’ll show you mine if you show me yours.” That is not generally how vulnerability disclosure works, and AFAIK, Cellebrite has not taken them up on the offer so far.
This was not an attempt at responsible disclosure, nor was it a specific exploitable disclosure at all. It was a wake up call to everyone, her included, that law enforcement tech is just as shitty as every other kind of tech. Her ideas about how things generally work are not really relevant, but that was literally all she had to say about that. Then back to the perfectly good lawsplainer which formed the vast majority of this opinion piece.
Also, what judges are going around being offended on someone else’s behalf, on the not-court-appropriate cutesy language used outside court in the course of vigorous public debate, by someone who is not even a party to the hypothetical proceedings she discussed? Yes, judges don’t like it when you get cute with them. We get it, you know judges, but this was not the same thing at all, the blog post was not a court filing. It just demonstrated the proposition that Cellebrite evidence was unreliable until proven otherwise. It said: “all ye who are affected by this, start your engines”. It certainly made her run around in circles trying to analyse the implications. That was the point.
Just because you have credentials, does not mean you infallibly know your ass from your elbow. It means you know how to apply a process to an end, and can be relied upon to reproduce someones idea of that process.
Meanwhile, real and substantive contributions come from those never priveleged with having someone else in a position to vouch for them.
Let the facts and results speak for themselves. Which in this case, won't hapen til the first case gets exercised well. Regardless of how it resolves, everyone else has room to opine, as the law has stake held in it by all of us.
Absolutely, and you realize that when it comes to legal matters that's exactly why we have lawyers (like the OP post author) and why lawyers spend years becoming lawyers so we pay them stupid amounts of money to interpret and opine for us on what a judge (or jury) will think of a given case? And why we don't consult people who flip burgers or drive taxis what their opinion about the same case is.
Where people are getting confused here is the difference between having an opinion on what you think legislation should be around evidence tampering (public policy) vs how a judge or court would decide on this specific issue given the laws as they are on the statute today (law).
What the OP wrote about is about is this specific case. How lay-people in this thread think a court would decide on Moxie and Signal's actions, if bought to court, is frankly irrelevant and especially when arguing with someone who is highly qualified! That fact that people here don't get this is the very point I'm making - you're not lawyers.
Matters of the law are all about Appeal to Authority, I don't understand what the problem is with that (have you never paid for a lawyer before??). Matters of public policy are for the public, there's a subtle difference.
Sorry to be just replying to your thread salawat but this applies to most of the comments here.
The fact that a significant criminal trial involving Signal, Cellebrite, and the CFAA would call in an expert witness also is worth remembering. The kind of expert witness that would be needed to break down and explain the "hack" and who also would visit this thread to read or comment.
The situation hasn't been tested in court and no helpful precedent exists, otherwise it wouldn't really be something that needs a discussion.
After all, laws are here to protect what the people consider important. Credentials are not necessarily the most important factor here.
No one needs to question the law portions of this to question the underlying premise.
Saying things like "this is bad because Cellebrite is currently being used on rioters" right after you claim what Signal may or may not have done will have no effect on evidence is a flimsy argument you don't need a law degree to oppose.
Ditto for implying Cellebrite should somehow be seen in a positive light because by... enabling and normalizing the invasion of privacy it... somehow preserves privacy?
As if politicians aren't more likely to wave the successes of Cellebrite as exactly why backdoors should be required than the opposite? And even worse, wave the failures that naturally occur as reasons for backdoors?
All I understood Moxie's original article to be doing was sowing that seed of "reasonable doubt." Is it now reasonable, based on Moxie's article, to doubt that information obtained by a Cellebrite device from a device running Signal is reliable? If I were a juror, I would probably think so.
That doesn't at all mean someone couldn't be convicted on the strength of other evidence, but if the primary evidence the prosecution relied on was Cellebrited off a phone running Signal, I'd have some trouble trusting it enough to render a guilty verdict.
I would expect a defense lawyer to say something like "The tool so confuses its input that it can mistake message data for its own internal instructions. How certain can we be that it has properly analyzed its inputs and maintained the necessary chain-of-custody metadata, and provided adequate protections against evidence tampering? If a police officer were unable to tell the difference between his or her own thoughts and things he or she had read, we would dismiss him or her as a reliable witness."
https://www.justice.gov/archives/jm/criminal-resource-manual... (just one example).
To be clear, all you accomplish with that statement as a defense attorney is that you didn't get a credible enough expert, as any Computer Scientist should point out that is the fundamental character of the Von Neumann computing machine architecture, the very model of computing that most computers are designed according to, and most programs are written to run against. They would then further expound that software development had developed methods to mitigate this problem, which minimize the llkelihood of such architecture quirks being exploited, and most certainly leading to a state of affairs where any such vulnerability could be identified via a source code audit. This would open the door for the defense to require the prosecution to produce source code for their tool to prove to the court whether the vulnerability exists or not.
A good defense would then follow up by asking whether or not there was some way to detect whether there had been a successful exploitation on a device. "That's where things get tricky", the expert should reply, "because if arbitrary code can be run, given enough time, someone could cover their tracks successfully. It is plausible a mistake could be made in terms of the implementer of the exploit missing a timestamp, not properly serializing something, not cleaning out a log that could be then reconciled with something else, but the possibility of a completely clean alteration given enough time and resource was still on the table.
The prosecution would then endeavor through chain of custody logs, affidavits, data on the device, possibly comparisons to other cases convince the jury this is all hogwash, and the defense is grasping at straws, and ultimately full of shit, without tipping the defenses hand that if this case is in question, other cases may be.
Mind the brilliance in Moxie's actions is not that he'd get someone off the hook, but that he's now forced prosecutors into a position where if they want to rely on Cellebrite data as a lynchpin of their case, they have to open the door to public scrutiny of the implementation. Of course, this will just be mitigated by law enforcement ultimately engaging in parallel construction anyway.
Or, Cellebrite updates/audits their software to mitigate the vulnerability, or re-implements it on a non-Von-Neumann computer.
Again, not a lawyer, just read some stuff on how to think like one once.
Here, by way of example, is the Grugq talking about this idea twenty years ago (presumably: about EnCase).
There is other forensic software used for desktops and servers that is very widely used in court cases. There are significant and substantial vulnerabilities there: https://www.cvedetails.com/vulnerability-list/vendor_id-3015...
This type of issue is not new with signal.
On the other hand, if it's chat with names in it, it's likely not from the booby trap.
Law enforcement doesn't confiscate and use Cellebrite on phones at random. If they have a warrant to search your phone, they already have some reason for suspicion.
For example, maybe someone accused the defendant of molesting a child, but the police didn't have hard evidence. They use Cellebrite and find some child porn. The defense argues that Signal might have planted it there with a booby trapped file that downloads stuff at random from the dark web. Do you think the jury will buy that?
At that point, why not just say you left your phone unlocked in public and a stranger probably used it to download the child porn?
(And, just to be fully clear, my support for Cellebrite/law enforcement in this situation is approximately zero. I just think that Signal could spend their time in better ways than going full nuclear against anyone who pisses the CEO off, which is what happened here.)
The article proposes the correct solution to this.
> Signal doesn’t have their own in-house General Counsel. At this point, with many millions of users around the globe depending upon them for their privacy, security, and even physical safety, they really should.
Even if the founder was then most composed person in the world that never made snap decisions, Signal is doing something a lot of people don't like. Those people have a lot of legal power and Signal needs to understand the playing field.
And by "anyone" we mean a billion dollar transnational corporation dedicated to putting his users at risk.
This is why I absolutely refuse to sign up for any more whatsapp/signal style apps.
Why? Signal is a nonprofit, has no investors to provide returns unto, has no subscribers or paying customers. Why can't they take a moral stance in the market? Who is it hurting?
I felt their post was entirely fair/fine. It's not like they've shareholders or revenue to worry about. They're free to do what they want. Even the client and server are free software, if Signal itself imploded tomorrow someone else could release a new fork with a different API URL configured and stand up a server somewhere.
> If they’re saying what they’re hinting they’re saying, Signal basically announced that they plan to update their app to hack law enforcement computers and also tamper with and spoliate evidence in criminal cases.
If you set up an anti-hack tool on your phone, you have no way to know if it's going to be the police hacking it.
At least I sure hope not.
There are lots of tamper-resistant devices that will self-destruct.
> The timing looks kinda fash. I also think the timing of Signal’s blog post was suboptimal. Why? Because Cellebrite devices were used in some of the criminal cases against the Capitol rioters, to extract data from their phones after they were arrested. It’s still early days in those criminal prosecutions, those cases are still ongoing, and there are hundreds of them. (I don’t know how many of them involve Cellebrite evidence.) The DOJ is already stretched extremely thin because of how damn many of these cases there are, and if even a fraction of those defendants got Cellebrited-upon, and they all decide to file a motion to examine the Cellebrite device and throw out the Cellebrite evidence, that will add further strain.
> Now, don’t get me wrong, I’m no fan of the DOJ, as you may have guessed by now. But I also don’t like seditious fascists, and I think the people who tried to violently overthrow our democratically-elected government should be caught and held accountable. And the timing of this blog post kinda makes it look like Moxie — who is famously an anarchist — is giving the fascists ammunition in their legal cases to try to get off the hook. As said, I don’t think it’ll work, and even fascists deserve due process and not to be convicted on the basis of bug-riddled spy machines, but it’s helpful to them nonetheless.
It's the usual knife/gun conversation again but indeed - as in the author's words - that likely won't get him anymore job with Signal.
The Law is blind, but the police are not. You can't buy into investigative techniques being employed in some cases and not others. Any type of edge will be exploited as early and as often as possible to build a case.
Regardless, those optics are kind of silly to apply, as they are largely irrelevant to the legal question at hand, even if they might be relevant at higher levels of the political machine.
This simply disrupts trust in Cellebrite. Nothing illegal. All Moxie is saying is "Don't want potentially corrupted data? Don't use Cellebrite." It absolutely is retribution for Cellebrite coming at Signal.
Ensuring not one innocent gets steamrolled by the judicial system is a positive social purpose.
Whether or not you consider it compelling enough to be worth it is another question. I unwaveringly acknowledge the positive value to what he has done. If you can't come out and prove there is nothing dirty or worthy of doubt with the tools you're using to strip someone of their freedom and liberty, you have no business using it. Period. As a society, we've compromised on a high standard for this far too long.
Cellebrite no doubt thought that hoarding vulnerabilities made them super smart, forgetting that everything they need to operate is now riddled with vulnerabilities that someone else has hoarded.
Doesn’t affect their business model though, which just requires bamboozling a jury of people who think the word crypto means ‘pyramid scheme my uncle invested in’.
& I don't like the Capitol rioters either, but I don't see how you can evince a belief in due process & the "rule of law" then criticise someone for potentially providing exculpatory evidence to a group of defendants you dislike. you can't have it both ways. and the implication that someone being an anarchist makes them more likely to want to help out fascists is odd, to say the least
1. Abolish the CFAA. All of it. It is unsalvageable. Nothing good has ever come from it.
2. I will never listen to Stanford and anyone associated with Stanford about ethics. You profit from parent trolls. You have zero moral high ground.
How about citizens have an expectation of integrity in using their computation devices that the state may not infringe upon. The state buying these tools and using them, in what is often a constitutional gray area, is harming all of us by making our devices less secure.
> But a lot of vendors [...] sell not only to the U.S. and other countries that respect the rule of law,
They lost me at the presumption that USA respects the (international) rule of law and has nice law enforcement.
As I understand it, Cellebrite devices are not exactly hard to acquire.
But if Signal got one, I'd be surprised if Apple couldn't. (Or if Signal wants to really stick it to cellebrite, they should loan their device to apple so apple can fix the security holes that cellebrite exploits.)
My understanding was that people will responsibly disclose information to protect the public.
Signal disclosing these vulnerabilities would have mostly protected Cellebrite, who have made it abundantly clear that the good of the general population is none of their concern and who's business model is based on keeping everyone insecure for their own profit. Now that is how responsible disclosure doesn't work.
This is an interesting question, since Apple/Google are actually on the same side as Signal on this one (vis a vis Cellebrite). If Signal is being vague/coy enough about what they're doing, will the app stores overlook the possible bad behavior on the grounds that "the enemy of my enemy is my friend"?
Says who? The intentional ambiguity may have had multiple audiences, quite possibly including computer people that handle the use of these products, their procurement, or their adversarial study.
> Neither is hacking somebody’s computer, which is what Signal’s blog post is saying a “real exploit payload” could do. It said, “a real exploit payload would likely seek to undetectably alter previous reports, compromise the integrity of future reports (perhaps at random!), or exfiltrate data from the Cellebrite machine.” All of those things are a violation of the federal anti-hacking law known as the Computer Fraud and Abuse Act, or CFAA, and probably also of many state-law versions of the CFAA
I'm not sure if that will hold in court. You can argue that the Signal app has built in hacking defenses. A more common case would be that Signal app detects that it is being hacked by Celebrite and self destructs (i.e. deletes all data) -- that's what an iphone does, if you make too many passcode attempts. In this case Signal jokes that it might counter hack even, but since it's a defense to being hacked in the first place, it shouldn't illegal.
Perhaps it shouldn't be illegal, but as of now it very definitely is illegal. There are no 'self-defence' clauses in current computer security laws, and any "counter-hack" is exactly as illegal as an equivalent "direct-hack", it literally does not matter if you did it as a defense.
I might also be charged with protecting information by constitution, law or international statute (e.g. as a health or legal professional), something that border officials often like to ignore, actually possibly even incriminating themselves in third countries and the us
I am also not responsible if a tool a third party provides is defect by choice and this defect causes damage - especially if the defect is already known and we'll documented through responsible disclosure (thx signal).
If I then warn them (in a general way) and they plug in anyway...
might be an interesting case, but should be well prepared, best with the help of a third countries lawyer's association as a test case ;)
This is pretty similar. Only hostile breach attempts are thwarted.
It may need precedent or legislation to be fully legal, however. I would hope for EU-wide legislation to that effect in short order.
First, the thwarted breach most likely isn't "hostile" - we'd assume that the law enforcement people running the Cellebrite tool are running it on a device in their lawful possession; and second, unlike in the money case, it's quite explicitly a crime to try to thwart their attempts, obstruction of justice is pretty much a universal concept.
Do remember that Cellebrite has more customers than just your local domestic (law enforcement) agency. In fact, that would obviously just be one customer. It thus follows logically that all the other customers are not your local domestic law enforcement agency.
Uh huh.
Tell that to the Uiyghurs currently lawfully detained in reeducation camps and being systematically genocided. Tell that to any person wrongfully imprisoned because a prosecutor wanted a slam dunk instead of making damn sure that the facts line up. Tell that to those of Jewish lineage, or who were on the wrong side of the legal/political edifice in Germany between the years of 1940 and 1945. The same for those of German or Japanese descent in the United States, those of Native American descent since before the United States was formally a thing, or those dissidents that crossed the ocean to get away from the legal reality that shaped their time.
There is an American cultural value that places that which is ultimately the moral right over that which is legal. I cannot for the life of me figure out how it seems to have gotten so wantomly diluted over the years, but I'm tired of hearing the argument that what is right is somehow constrained by what is legal. It's the other way around, consequently in flux, resulting in a moral imperative to exploit an inflexible legal system with as much care, due vigilance, and as much scrutiny on all sides (prosecutorial/law enforcement conduct, criminal activity by those unapprehended, the treatment and rehabilitation of those that were apprehended, and the public's overall safety from the other three) as possible if the values of Liberty and Freedom mean anything at all.
This is how moderates get you to give up your rights, because they'll convince you that if you don't give up some of your rights, you'll wind up losing all of them, and nobody wants that to happen. It is very Good Cop / Bad Cop.
Is this applicable?
They just pointed out that the software is poorly constructed in a blog post.
Any claims otherwise are premature.
Even their claims they they might put such exploit files on Signal devices were written in such a way as to be plausibly deniable.
Until and unless a Cellebrite device is known to have been exploited by such a file, we are speculating idly.
(FWIW, Signal doesn't even need to deploy the files now to have tainted the evidence that comes out of any Cellebrite device. The blog post was sufficient.)
Let's also consider cases that could have warrants that would not have been approved if the integrity of the data from a Cellebrite extraction was questionable. I could see some defense lawyers challenge the validity of warrants from this.
https://en.wikipedia.org/wiki/Good-faith_exception?wprov=sfl...
Cops can get warrants based on much less reliable sources, such as a statement from a witness or an informant.
But IMHO (IANAL) this won't actually have an impact -- the defense would need to have some evidence that the particular Celebrite machine was hacked and that this had an impact on the data taken from that particular device. "It could've been hacked" is purely speculative and isn't nearly enough to get evidence thrown out. I mean, courts routinely accept phone screenshots as evidence -- "it could be a fake screenshot" is much more likely thing to happen, and yet you'd still need to provide evidence that the screenshot might be fake.
Not to mention that the bar for warrants is even lower -- you only need "probable cause" in the US.
The defense doesn't need to prove anything except that the prosecution hasn't done their job of assuring they've chased down everything they have to.
The prosecution, if relying on Cellebrite, can no longer just say "we dumped the contents of the phone" without picking up the additional investigative burden of proving their chain of custody was not maliciously tampered with successfully. That means source code audits, admitting knowledge of the tool into the public record, or doing cross checks with another tool that isn't known to be vulnerable to an undisclosed exploit, which only holds out til the same type of thing happens to the other tool.
>“For example, by including a specially formatted but otherwise innocuous file in an app on a device that is then scanned by Cellebrite, it’s possible to execute code that modifies not just the Cellebrite report being created in that scan, but also all previous and future generated Cellebrite reports from all previously scanned devices and all future scanned devices in any arbitrary way (inserting or removing text, email, photos, contacts, files, or any other data), with no detectable timestamp changes or checksum failures. This could even be done at random, and would seriously call the data integrity of Cellebrite’s reports into question."
A tool with such a vulnerability, one that can affect past, present, and future uses of it, absolutely calls into question the "forensically sound condition" of the data it produces. One wouldn't even need to argue that they or the person they are representing was the one who could have corrupted the data. It could have been any previous device that was scanned.
I have personally spoken to important figures in these countries with great political power or influence in the economy.
Usually they`re very anti privacy except when it comes to their personal shady dealings.
“Obstruction of justice” is a moral imperative when “justice” is defined and administered by those with the moral character of Roland Freisler.
1. cellebrite is ultimately good because it allows governments to spy on, harass, imprison, terrorize, torture, and murder its citizens, esp its journalist citizens, and
2. moxie used the wrong tone in his blog post.
something tells me this person doesn't think of themself as a typical government hack, which is presumably the only reason this blog post would be interesting enough to HN to show up here?
also interesting that this person thinks that cellebrite only sells their tech to 'authoritarian' governments.
which ones are those?
> But Cellebrite has lots of customers besides U.S. law enforcement agencies. And some of them aren’t so nice. As Signal’s blog post notes, “Their customer list has included authoritarian regimes in Belarus, Russia, Venezuela, and China; death squads in Bangladesh; military juntas in Myanmar; and those seeking to abuse and oppress in Turkey, UAE, and elsewhere.”
Thunderbolt 4 allegedly includes mitigations to prevent arbitrary DMA transactions and Thunderspy.
https://en.wikipedia.org/wiki/Thunderbolt_(interface)#Vulner...
Btw, partial list of USB attacks:
https://www.bleepingcomputer.com/news/security/heres-a-list-...
https://www.sciencedirect.com/science/article/pii/S016740481...
I think it's an opinion that messing with law enforcement is _bad_.
If they do hire in house counsel the first that guy would tell this is “call Cellbrite and tell them exactly what the vuln is and how to mitigate it.”
It's prohibited to alter data on someone else's computer systems (CFAA), so what matters if that file was placed there with the hopes that it would overwrite someone else's Cellebrite database, and it doesn't matter if you placed it on your phone or sent it over a phishing email.
And as a separate crime, it's forbidden to destroy or conceal evidence or things that would be used as evidence, no matter if that evidence is files on your phone protected by such a buffer overflow, or a gun that you throw in a river.
In essence, storing such a file is illegal if the jury gets convinced that you placed such a file with the goal to have that buffer overflow to actually happen on someone else's machine.
For an exaggerated example, if someone is tried (among other things) for routinely performing some illict acticity (i.e. they clearly had an expectation that they might be arrested and their phone analysed by LE) and has prior arrests in which their phone was actually analysed, which they knew and didn't like and after one such arrest they just "place the files", then it would be straightforward to get a conviction; and on the opposite direction if a privacy activist using all kinds of interesting features has had this thing on their phone for years and then gets detained for something unrelated to that (i.e. not a case of e.g. putting these files in the morning before going out to do some activism that's likely to get them arrested, but perhaps before going to Saudi Arabia - deterring foreign agents instead of local LE would be a legitimate purpose), then indeed it would be difficult to prove that they had a specific target in mind.
It's not a crime to exploit vulnerabilities in software developed by someone else, it's a crime to exploit vulnerabilities to do things on systems owned/run by others.
A LE officer with a proper warrant running Cellebrite extraction tools on your phone has full rights to execute exploits on your phone.
On the other hand, the phone's owner or Signal has no right to execute exploits on that officers' computer with Cellebrite tools. They can get their own computer with Cellebrite tools (as Signal did) and exploit vulnerabilities there as much as they want (as Signal did), and not tell the vendor the details (as Signal did), that's all legal, but deploying an exploit on phones with the intent that it might get executed on someone else's machine is illegal.
The law doesn't look kindly on prior restraint.
Signal isn’t saying “we’re just hacking into property we have a legal right to access” (which is what LE is doing in the US) they’re essentially saying “we’re gonna hack and damage government property and police evidence”
If Signal set up their phones so the user could click “I’m gonna do crimes, opt me in” and it would add the nefarious files, the risk of prosecution would seem much more likely.
“The police” generally don’t sue, The State charges. And for the state to charge someone with a crime, it can’t just vaguely be “hacking”, it would need to be a violation of a criminal statue. At best, this would perhaps be tampering with evidence? Because I doubt you’d find a jury willing to convict someone of a violation of, for example, the CFAA, for activity that they undertook solely within their own app, which did not initiate any activity until scanned by Celebrite’s tool
But if some app actually decided to use this hack, then wouldn't it be likely that in addition to modifying the contents of the data dump it would also modify the on-device data? In that case it wouldn't matter if the other vendors have vulnerabilities, since the device itself was already compromised.
Edit: changed disruptive to interesting. There could be many many more disruptive versions...
E.g. such a claim might result in a forensic analysis of that Cellebrite computer, and if the analysis indicates that it indeed got infected with a virus when scanning someone else's phone, that's likely cause all the evidence to be questioned, but again, even in that case there may be other ways than the Cellebrite logs to confirm that this evidence was indeed on your phone (the original article asserts this as well).
So many words to state the obvious that like, for example, this would be illegal? Did the coy language not tip you off to the fact they realize that? Then suddenly trying to champion Cellbrite as the reason we something as anti-privacy as backdoor mandates and encryption bans while at the same we're already seeing countries inch towards that?
And then seriously, acting like because Cellbrite is being used against rioters somehow this was a bad time for Signal to point out the fact that Cellbrite is an insecure pos on top of it's dubious intended purpose?? Didn't I just go through 1000 words explaining why what Signal did won't matter anyways?
-
This whole thing just reads like someone who needed to go "well actually", it's not really saying anything novel or interesting, and in the pursuit of defending Cellebrite of all things, it makes some pretty dubious connections.
Also, is leaving a file that breaks the admissibility of previously gathered evidence considered active hacking? Am I misunderstanding something about the function of the files in Signal? I thought the only way Cellebrite's software is interacted with is if it tries to access Signal on the device. Signal isn't actively searching to hack back. It's triggered by Cellebrite's software, not Signal's.
The straightforward workaround would be to delete Signal before using the Cellebrite software which I think is the real point. Signal isn't trying to protect the end user actively and can't do anything if it's not installed on a phone.
Are you sure that is the case 100% of the time?
Bars on my door keep out burglars as well as hinder police serving a warrant.
Even if Signal does deploy these files (no evidence thus far that they have deployed Cellebrite exploits, as their blog post was careful not to claim that), the vast majority of them (just like deadbolts) will not be used to hinder search warrants.
Until they find they're in the wrong house. Or that a warrant is invalid.
Yes this is called booby trapping and at least in the US is illegal. It’s akin to tying a trigger to a door opening so that whoever opens the door gets shot, even if that person had no right to be there, you can still be held liable for any injury the bullet causes.