Indeed. But requiring data, source code, and weights on papers submitted for peer review would solve a lot of this. As well as making data sets and data collection processes reproducible and open such that anyone can verify it end to end. LLMs can be open and set up such that they curate this for people too. You know how AWS has a status page for availability? We could have status pages for LLM data training set integrity.
It will be way more manageable and truthful this way than in the existing way where some European bureaucracy (disclaimer: I am European) sits in front of my and your access to GPT-4 or an LLM running on our boxes directly.