I agree that AI companies shouldn’t be allowed to bar distillation under grounds of fairness and societal benefit.

But I don’t see how copyright has anything to do with anything. Copyright is a legal concept, not an ethical concept. Training an LLM on copyrighted material is legal. Ethically, whether a work that the LLM trained on is copyrighted or not has no relevance