Exactly my experience. The key is to start the conversation in a way that also allows the other person to exit and save face. If they don't feel trapped it's much lower stakes for everyone involved.