I think this is a paradox that AIs have introduced.

We write open source software so everyone can learn and benefit from it. But why do we not like it when they are being trained on them and allow normies to use it as well?

We want news, knowledge and information to be spread everywhere. So why don't we share all of our books, articles and blogs openly to any AI companies that want to use them? We should all want to have our work to be used by everyone more easily.

Personally, I don't have any fundamental refutation to this. There's a sense that it is wrong. I can somewhat articulate why its wrong in term of control and incentives. But those are not well formed just yet.