Just don't have an argument about a book or you could end up on death row. Gordon Dickson wrote a short story about this https://en.wikipedia.org/wiki/Computers_Don%27t_Argue
"An AI erroneously banned the channel," shouldn't get any more leeway than "A support staff member banned the channel."
What would curtail the leeway then? Other than losing public trust in the product for this happening repeatedly anyway?
Personally, I think the AI is a total red herring.
Genuinely asking: what do you think profitable companies would do to their ML engineers over a product issue like this if there was no law under which they would be sued?
I think accountability without an enforcement mechanism is just a wishful suggestion.
Nothing. Maybe a reprimand at best, because the consequences of this are fairly minor. If a store erroneously bans you and them unbans you and says that there was a mixup with their policy, then what do you think should be the consequences to the store? If it's effectively a monopoly then I can see there being problems, but if it's just a random store then that doesn't really matter.
Either they automate removing content and end up removing some of the good with the mountains of bad, or they do it manually which costs a fortune and is too slow.
The local news is still ridiculing Facebook because they left the stream up for the NZ shooting for hours and their stated reason "No one watching the video had reported it". Well what do we want facebook to do? Hire thousands of people to watch every single livestream live?
IMO we should all move to some kind of self hosting where there is no central mega corp that takes responsibility for the content. You host your own content and you stand behind it legally. As long as its legal content, you have no risk of being shut down.
I think this is a false dichotomy; they could automate flagging for human review instead. This would address the cost though not the speed.
Content awaiting review could be disabled, or it could be disabled only if it is deemed sufficiently egregious.
I'm not sure this would save them in many cases. Most of the abusive content on facebook is not easily identifiable. I don't think the current AI systems are up to the task. They may be able to identify a human and a dog are in the video but not tell the difference between petting the dog or punching it.
Similarly they likely can not tell the difference between someone at a shooting range or committing a mass shooting.
Just like it is too much to expect police to stop all crime before it happens, I think it is too much to expect platforms to remove violating content before it is reported.