Really depends on the domain and the engine. OpenAI code generation is staggering (https://www.youtube.com/watch?v=SGUCcjHTmGY&t=1214s), its summarization and classification is still very much a work in progress.
For instance, there's a lot of manual clean up work put into things like training data sets for speech recognition because there has been a lot of investment there. Same with self driving I assume because so much $$$ got invested there.
Radiology scans or cough based COVID detectors or medical claims on the other hand? I wouldn't expect it. It's just researchers trying to get a quick paper without adequate funding.
These are really the exception rather than the rule when it comes to collecting data for ML/AI applications.