After rotating the image 90 degrees, the predicted result changes substantially. The author should not be surprised. A convolutional neural network is translationally invariant, not rotationally invariant.
Standard convnets do not contain explicit rotational invariance (unless you include a layer such as this: arXiv:1506.02025v1). They can however learn rotational invariance if you feed them rotated images.