The issue is that pickpockets and others looking to target more "naive" tourists will be less likely to target you if you're dressed less like a tourist.