In my experience the truly impossible collaborations always involved people who wanted to play politics, take credit for stuff they didn't do, undermine me etc.
On the other hand I was almost always able to remove friction if the person I was working with was well-intentioned and non-political.