There are a lot of similar failure modes in humans.
Sometimes they're are used for good, like making drivers slow down: https://www.insider.com/optical-illusions-3d-crosswalk-drivi...
But other times they cause crashes: https://imgur.com/a/kYr94
Sometimes they're are used for good, like making drivers slow down: https://www.insider.com/optical-illusions-3d-crosswalk-drivi...
But other times they cause crashes: https://imgur.com/a/kYr94
there are lot of similar failure modes in individual humans. The difference is individual driver errors are not correlated, a bad reflection tricks a few humans at once instead of tens of thousands of cars running the same model. There is significantly more brittleness in a fleet of cars than in a population of humans, because the human population has diversity in judgement and experience.
This is not simple to fix because this uniformity is actually a feature of automated systems, it makes them explainable, produces expected results and conform and cheap, training a human for 20 years is more expensive than training all the cars once. However it also makes them collectively vulnerable, which is why heavy machines tend to be locked away on factory floors.
it seems to be the opposite of assistive. How can a person know all the weird things that will make a computer vision system badly fail. It shouldn't be used at all if that is the case
The effect is more like: What is this for strange art!?