Eh, I'm not entirely sure I would have. The effect is near identical to when you have one person behind another, pretending to be the front person's arms and hands - the motions just don't match up right.
Maybe people who use faces more than full body language are more affected by this particular one?