Good luck convincing a town of people to not recognize a tourist by their clothing. What does that even mean anyway?
I'll also add that the reason that you wouldn't want to dress like a tourist is to mislead locals about what you actually are, which is a tourist. Judging you substantively would mean judging you as one of the tourists that makes them want to leave the town they grew up in.