Hacker News Reader

Combine this with Apple’s new photo scanning tech and this could be a new way for bad people to SWAT someone else. Assuming you could fool Apples classifier, just text that manipulated image to the target and they will get flagged.

Any image on the internet that you save to your phone is now a risk to yourself, even if it looks innocent.

View on HN

Probably easier to slip a "naughty" image that doesn't contain a minor into the image database. An image that resides in a target's iCloud storage. Or soon will.

Then it would take a super high level human reviewer to determine that original image, although sexual in nature, is not in fact illegal.

There are so many parties that can submit images to this database, it presumably wouldn't be too hard to subvert one of them with cash or laziness.

This research indicates that every neural-net-classified input sourced from an uncontrolled environment probably wants human review (if the neural net's owner wants to minimize malicious false-classifies).

Reply on news.ycombinator.com