The Face Scan Arrives
nytimes.com
nytimes.com
"Before the advent of these new technologies, time and effort created effective barriers to surveillance abuse. But those barriers are now being removed. They must be rebuilt in the law."
Time and effort maintained privacy in the past, by default. However, as technology improves, privacy is no longer the default, so we need to request it, specifically.
I hear again and again that "no one cares about privacy", but I'm starting to think this is a relic of the past. Perhaps 10 years from now we will say "no one used to care about privacy, but that was before technology became sufficiently advanced."
Someone like Lady Gaga is basically untrackable if she's wearing any of her usual ununsual outfits.
You'll stand out more to a human observer, but to a computer you'll be invisible.
Or you could just have really dark skin. That usually works just as well. (Example: http://www.gamespot.com/news/kinect-has-problems-recognizing...)
I also have some concerns of inadvertent "software racism". See for example, this video: https://www.youtube.com/watch?v=t4DT3tQqgRM. Obviously facial recognition isn't inherently incapable of recognizing people of different races, but if it's designed and calibrated on subjects of one race, it won't necessarily work well for subjects of different races. The last thing we want is a facial recognition database that thinks e.g. all Arabs look alike.
And of course, there are a ton of ways that it can be thwarted easily and inconspicuously, even if it works very well. Are all surveillance cameras going to be fitted with IR filters to ensure that a bright IR LED necklace doesn't blind them? And how hard is it for a criminal to hire a makeup artist?
Surveillance is going to happen, if you ban government surveillance, the public will get this tech and drones and be doing it anyway. So the robust way to fight it is to plan your life knowing that you can always be monitored and someone will always know where you are, even at home.
This is a great opportunity for startups. Webapps that allow you to plan your security, kind of mini-fiefdoms with your family, friends, neighbors, associations that plan against attacks from rivals. Electronically activated weapon systems that shoot when a threat is detected. The Mad Max era is coming, and hackers will get many opportunities to earn a fortune.
You can already obscure all of your face except for your eyes with just a strip of cloth, which will have the exact same effect.
http://www.youtube.com/watch?v=TrVLh6r8hd8&feature=player_de...
Because it wasn't clear to me at first, I'll just point out that the pilot for this thing is using a VR headset similar to Oculus Rift, and the video is sent back to him over wifi. Supposedly the range is on the order of a mile or so.
I didn't even realize this was a feasible thing already! Looking into it, you can get these things for only $1500 or so. And so suddenly I've just realized, 10 or 20 years from now, it's not just the police who will be flying these things around. Why not buy one to use for your own neighborhood watch, right?
Hell, I'd love the chance to fly one of these around just for fun.
On the contrary. In a year or two, it might not be just the police. In 10 or 20 years, I expect they will be regulated, a licence will be required to operate one, and they will be required to transmit identifying information at all times. Apply any argument you like that relates to driving on public roads, any argument you like that relates to handling potentially sensitive personal information, or any argument you like to do with navigating crowded airspace.
I think you will see a rise in people wearing desquises? Or, maybe an Indian will eventually sue the offending store on religious grounds? (steal the soul)
Yea, I'm rambling, but I sometimes feel like we lost all privacy? And yes, this is the only site I comment on anymore. I don't even trust this site. I bet they are logging in all IP's, and saving them just in case the government comes a knocking?
Let's face it, you're won't going to walk around with a VR headset on your face unless you're a) wireless connected to a server, or b) enjoy taking a heavy backpack or cart of gear everywhere.
Plus, unless you build the hardware entirely yourself, the headset won't save you from other tracking technologies. Presumably the headset will have a wireless chip whose MAC can be tracked, or, worse, it'll have an RFID chip specially-built for government tracking.
My chief worry is overconfidence from hopelessly technologically ignorant bureaucrats combined with a slew of false negatives and false positives when applied to human faces on general surveillance feeds.
In contrast, driver's license, ID, and arrest photos are at least severely constrained input filters wherein a single individual is placed against relatively uncomplicated background pixels and the face is in roughly the same orientation.
It creeps me out.
Granted, they are working with the much smaller set of people I know rather than the whole populace. But technology only gets better.
Technology is bounded by mathematical constraints, though. The more you constrain the number of faces you are scanning and you are looking for, the easier the task is. But when you're trying to pick out any of perhaps thousands of persons of interest across an input set that is, say, in the millions, the more impossible it becomes.
If it helps, imagine that you've equipped a person with all the people they're looking for, and then set them up in front of the cameras. Even if you imagine a superhuman who somehow has time to examine all of the millions of inputs, even the human is going to have a huge number of false positives and negatives. The problem itself is fundamentally, mathematically hard. Any surveillance technique based on the idea that computer vision is better than human vision at this sort of thing is going to fail, hard.
And that's before the population starts taking active countermeasures against the face metrics. (As usual, despite the abundant evidence we live in a dynamic, reactive universe, most humans persist in functioning in a static model, where the Bad Guys will just passively sit and let their faces be scanned and never react to that.)
http://news.discovery.com/tech/gear-and-gadgets/glasses-foil...
But at least we'll fall victim to a higher, rarified caliber of terrorist rather than that awful riffraff we're dealing with now.
Identifying which person a face belongs to is a classification problem, which gets difficult the larger the set you're comparing to. Facebook has some tech that is interesting here, but it also only checks your friends and some level of false positives is acceptable. I imagine it that what algorithms they have aren't quite good enough to, say, identify your face out of an entire city's worth of driver's license photos. (Yet, which is what this article alludes to.)
1. Yes /without/ this technology, and
2. How would that have prevented the Boston tragedy if it were in use?
What exactly does NYT mean here.
Or more to the point: as the NSA mandates access to all private data, the distinction of recordings from public spaces and recordings from private spaces is made moot.
Just beware of Bonferroni's Principle:
http://math.stackexchange.com/questions/352689/bonferronis-p...
They might find hundreds of pictures of you with timestamps and locations.
(This is all speculation; I haven't written image recognition software myself.)
Oh, it's really, really fast. My current system is based upon two generations back of neural nets, and they reconstruct from one photo in 0.9 seconds. The latest generation does 144 reconstructions simultaneously given HD video feeds.
BTW, all the best with your website. Hope you take more avatars "where go where no man has gone before!"
http://www.cs.cmu.edu/~vboddeti/papers/ijcb_2011.pdf
I have two more in the pipe (one still awaiting acceptance, and the other is accepted but yet to be added to IEEEXplore)