That's because Histogram of Oriented Gradients is not invariant to object orientation: http://en.wikipedia.org/wiki/Histogram_of_oriented_gradients... (second paragraph).

This example app was trained on upright cats.