From what little I understand of LLMs, the weight network developed by training on a large collection of inputs is similar to human knowledge in that some things will be clearly derived (at least in part) from a limited number of inputs but others might have no clear contributor density. If I wrote a human "superiority" science fiction story, I could be fairly confident that Timothy Zahn and Gordon R. Dickson "contributed"; however, this contribution would not be considered enough to violate copyright and require licensing. Some LLM outputs clearly violate copyright (e.g., near verbatim quotation of significant length), but other outputs seem to be more broadly derived.
If the law treats LLMs like humans ("fairly"), then broad derivation would not seem to violate copyright. This seems to lead toward "AI rights". I cannot imagine how concepts of just compensation and healthy/safe working conditions would apply to an AI. Can a corporation own a computer system than embodies an AI or is that slavery?
If the law makes special exceptions for LLMs, e.g., adjusting copyright such that fair use and natural learning only apply to human persons, then licensing would be required for training. However, attribution licenses seem to have the above-mentioned loophole. (That this loophole is not exploited may be laziness or concern about admitting that following the license is required — which makes less openly licensed/unlicensed works poisonous.)
If the purpose of copyright is to "promote the useful arts", then the law should reflect that purpose. Demotivating human creators and the sharing of their works seems destructive to that purpose, but LLMs are also enabling some creativity. Law should also incorporate general concepts such as equality under the law. LLMs also seem to have the potential for power concentration, which is also a concern for just laws.
Perhaps I am insufficiently educated on the tradeoffs to see an obvious solution, but this seems to me like a difficult problem.