Sorry if this sounds condescending. I'm asking out of total naivety. What is the background of people who typically run A/B tests? Are they often unfamiliar with things like multiple comparisons, stopping problems, and the like?
I think that background varies - some people are fluent statisticians and others come from different disciplines / careers. Anecdotally, my experience from browsing A/B testing advice online is similar; some content is very statistically savvy and some is a bit oversimplified.