The biggest problem A/B testing is ethical.

Every patient deserves the best medicine we can provide, so A/B testing, even though it would work in the long run, is unethical.