It's a historical fact, it has nothing to do with your experience.
http://en.wikipedia.org/wiki/Yoga#Reception_in_the_West
Let me save you the trouble while I'm here:
"...legitimizing yoga as a purely physical system of health exercises outside of counter culture or esotericism circles, and unconnected to a religious denomination."