In terms of long term A/B testing, companies really need to start understanding how harmful and confusing it can get for their user base. As much as I absolutely hate Facebook, I still have to use it for certain groups. Within the 4 people in my immediate family that use the app, we all had vastly different interfaces for the longest time and could never help each other navigate and find some specific option or feature.