My university's career coaching always told us to dress at the level of the workplace + 1.

I think this is a good rule. You look good, but not awkwardly out of place. Perhaps it's an unfortunate social rule that we shouldn't have to follow, but I've learned to shrug my shoulder to a lot of such rules and just go with it.