Isn't this already what private companies are doing? Google and Facebook especially have the ability to create huge profiles about your life and activities. They could almost certainly make highly productive models on people's activity.

The concern about facial recognition and deep learning should be about its use in general. Perhaps I am fortunate with where I live. I am far more concerned about technologies use with private companies than I am with the local police.