https://pub.towardsai.net/the-air-gapped-chronicles-the-cour...
The use case here is police facial recognition. Not hitting nails. The parent wasn't saying "AI is a liability" with no context.
The problem here is incidental to the tool; it was done by the cops and therefore nobody will be held accountable.
That would be the vendors, the system planners, and the institutions that greenlit this. It would also include the larger financial tech circle that is trying to drive large scale AI adoption. Like Peter Thiel, who sees technology as an "alternative to politics". I.e. a way to circumvent democracy [1]
[1] https://stavroulapabst.substack.com/p/techxgeopolitics-18-te...
As much as I detest Clearview and Thiel the fault for this incident falls squarely on the justice system.
You are also conflating legality and morality. The US gun industry being good at lobbying has no bearing on whether an industry that enables mass school shootings is accountable or not. I mean it clearly is. Just compare gun deaths in the US to any civilized nation and you'll see that gun control is the moral and sane approach.
A hammer/gun is not the same as the wider hammer/gun industrial system, and the societal systems it is a part of. The justice system is a part of that. So even though you say you disagree, somehow you still agree?
No, it responds to the claim you made. You asserted that systems are also tools and attributed fault on that basis. Perhaps at least reread your own comment before condescending.
> You are also conflating legality and morality.
Also incorrect. I understood you to be claiming tool vendors to bear both legal and moral responsibility; perhaps I misunderstood. Regardless, my position is that tool vendors bear neither of those more or less unconditionally. The only way a tool vendor can become responsible in any sense (IMO) is if they knowingly and intentionally facilitate a particular outcome. The manufacturer of a hammer, gun, or AI facial recognition system is never at fault for what the user does with it unless they actively encouraged that particular use.
Only one small little problem --- there is no way to tell if you are using it "correctly".
The only way to be sure is to not use it.
Using it basically boils down to, "Do you feel lucky?".
The Fargo police didn't get lucky in this case. And now the liability kicks in.
https://www.lawlegalhub.com/how-much-is-a-wrongful-arrest-la...
Look for similar to play out elsewhere --- using unreliable tools for decision making is not a good, responsible business plan. And lawyers are just waiting to press the point.
At some point, you have to decide if wasting good money on bad intel makes sense.
I’m very opposed to AI in general, but this one is clearly human failure.
The noteworthy AI angle is the undeserved credence police gave to AI information. But that is ultimately their failure; they should be investigating all information they receive.
Absolutely.
The failure starts with tool vendors who market these statistical/probabilistic pattern searchers as "intelligent". The Fargo police failed to fully evaluate these marketing claims before applying them to their work.
So in the same way that the failure rolled down hill, liability needs to roll back up.
But...
> there is no way to tell if you are using it "correctly".
This simply isn't true, at least in cases like this.
I know common sense isn't really all that common, but why would you give more credence to an untested tool than an untested crack-addled human informant?
The entire point of the informant, or the AI in this instance, is to generate leads. Which subsequently need to be checked.
But this approach negates much of the incentive to pay for questionable results.
As is true with results from people.
> But this approach negates much of the incentive to pay for questionable results.
I'm not sure that follows. Even the crack-addled human informant has always been paid for questionable results.
People as untrustworthy as AI often fail to maintain their jobs.
Now, if I misused a hammer and it hurt everyone's thumb in my country, then maybe what you said would have some merit.
Otherwise, I'd say it's an extremely lazy argument
I wonder if AI / shadow IT will change that.
I doubt it.
Computing has traditionally been all about math and logic. This is really all that a binary logic computer is capable of. When applied to this purpose, it can offer highly accurate results at very low cost.
Current AI is an attempt to branch out from simply calculating into decision making. But it does so in the worst possible way --- using probability and statistics (aka guesswork) instead of logic and reasoning. In other words, AI offers questionable results at high cost.
As this article shows, relying on guesswork is a legal liability issue waiting to happen in many (if not most) operating environments.
I fully agree, this seems like a legal liability issue waiting to happen.
Engineering isn't the one creating the liability issue here --- marketing is.
And it starts with using the word "intelligence" to describe what an LLM does.