Your friend is likely projecting. People simply don't care that much about what others in the office wear.