The main argument I have seen (which is also OpenAI's in their legal briefs) is that it is fair use. The idea of "fair use" is that you are conceding that you are infringing by creating a derivative work, but it's still okay. Implied in the fair use argument is that it is a derivative work.