Surprised no one has mentioned Doug Bowman's reasons for leaving Google, which seems in part because of extensive use of A/B testing. I don't really know enough to comment on it but it seems relevant: http://stopdesign.com/archive/2009/03/20/goodbye-google.html