> A/B tests work fine if the signal you are measuring is strong. This is not the case here.
The (fictitious) signal they are discussing here is very strong. Scroll down to the figure labeled "posterior distribution of p" and you can see that the two distributions barely overlap.