There's a real chance of rapid decline as the advance we've seen on GPT3 was largely due to openAI being able to efficiently train it on common crawl but now this data body is getting poisoned by automatically generated content.