It's not a privacy concern until someone takes the small step of being able to track a phone with surveillance cameras. With technology like this, I can't imagine it being much more difficult than plotting the viewing areas of the cameras and then overlaying the positions of various phones on the same map. This approach won't immediately point out the person the phone belongs to but you could easily have video coverage of the person available for review. You can always pick them out of the imagery later.