No, the "weights" of your model are trained from the input data.
What is usually AB tested are hyperparameters of the model, or different "flavors" of (model+input data).
Maybe after every update to the model, they check these stats to ensure that they haven't biased towards Elon Musk, and if so roll the change back.