I dunno about that. When I see someone who's wearing decent clothes, I still think, 'wow, that's someone who wants to look good.'
But I think that I'm a bit weird — I actually enjoy dressing differently for different occasions: it helps me get into the right headspace. Programming while wearing hiking clothes would make as much sense to me as hiking in a tuxedo.