That only works if those colleagues care about what you think of them