If appearing obviously fearful is enough to significantly increase the chances of people hassling you it's a pretty good indicator that you're in a bad part of town.