"Meta tells The Verge that, for now, it’s not training on your unpublished photos with this new feature. “[The Verge’s headline] implies we are currently training our AI models with these photos, which we aren’t. This test doesn’t use people’s photos to improve or train our AI models,”
As someone who is familiar with the ML space, it seems unlikely that the addition of private photos will significantly improve models, as you have mentioned.
I saw this line in the article: "Meta tells The Verge that it’s not currently training its AI models on those photos, but it would not answer our questions about whether it might do so in future, or what rights it will hold over your camera roll images."
It would seem important to share this with people who may 'not read the article'