What you highlighted is the reason why I wrote it. Most of the discussions are of an abstract harm against an immediate one. They other those involved.
My experience isn’t unique. It’s fairly mild.
There are people who have gone to jail because of a mistake by an algorithm. And many who have been arrested. Here’s one with Apple involved, https://www.businessinsider.com/tech/a-teen-is-suing-apple-f...
The harm is real. And I have been on both sides. I am a survivor of childhood sexual abuse. I know this would not have helped in my case. And in the cases of the other survivors I know. It was our environments that led to our experiences. The adults ignored it, were in on it, or in denial.
Apple is trying to solve a complex social problem with an algorithm. One that we are supposed to trust has been made without errors or bugs.
I can’t see the upside here.