Why would it matter if I stored exact copies of copyrighted works? Storage format is irrelevant. All you need to say is in that last sentence: it’s all about whether the output is considered a derivative work or a too close of a copy.
But that's the thing, LLMs don't store exact copies and neither can they reproduce them. The cases of regurgitation have only been shown to work for a very small handful of extremely popular works.