There's quite a few problems in traditional A/B testing. See here for example: https://volument.com/learn/problems-in-traditional-ab-testin...
On the other hand, doing A/B tests for small changes can also have a significant impact on your overall results. I think doing A/B tests is better than not doing them at all.