The challenge with these models is that they’ve clearly been trained on (exposed to) copyrighted material, and can also demonstrably reproduce elements of copyrighted works on demand. If they were humans, a court could deem the outputs copyright infringement, perhaps invoking the subconscious copying doctrine (https://www.americanbar.org/groups/intellectual_property_law...). Similarly, if a person uses a model to generate an infringing work, I suspect that person could be held liable for copyright infringement. Intention to infringe is not necessary in order to prove copyright infringement.
The harder question is whether the models themselves constitute copyright infringement. Maybe there’s a Google Books-esque defense here? Hard to tell if it would work.