Growth hormones we artificially add to cows are a whole other ballgame. I am not sure why anyone would drink milk from cows that have been artificailly manipulated to increase profit margins. (Oh, but it's $1 cheaper! I get it!)
That's not to say that there aren't risks, and that sometimes the costs outweigh the benefits, but to condemn genetic or hormone manipulation on the basis of it being manipulation just seems silly. We don't complain about the use of engineered alloys over "natural" iron.
I looked for some peer-reviewed articles about this, and found:
http://www.sciencemag.org/cgi/content/abstract/249/4971/875
But of course, you should still support sustainable agriculture, especially since organic milk is not significantly more expensive than "conventional" milk. (Oh the irony of that term...)