This is a good example of how A/B testing the wrong things can kill your product.