Perhaps the incentives of said UX team don't align with those of the user. They might be optimizing for maximal time spent on the site, for instance.
The YouTube team has been blindly chasing monetization at the expense of their website being useful and pleasant for a while now. Unfortunately it seems they can get away with it. I wrote this post to just shake my fist at the cloud