You work in a building full of men who look ridiculous. They and their peers may not care, but many do. And what's the point of needlessly alienating others?
I think fashion and the disdain programmers have for it play a role in creating the popular misconception among non-programmers that skilled software people should be very cheap. Skilled professionals dress like skilled professionals. Look at doctors and lawyers. Deal with it or deal with the consequences.