I don't understand why this is varying so widely person to person. I was just able to use a photo of a famous athlete and a photo of myself and get them to shake hands in a photo of a location where neither of us have ever been.
Some people I work with are having similar experiences to you though, but it's wildly inconsistent.