An LLM trained on public-domain or liberal-license material would be a great counterexample ... if anyone built it. The popular models in wide use do disclose what they train on (sometimes under NDA) and they all contained copyrighted work.
Once you know what behavior you want from the net, recreating that from non-copyrighted material might turn out to be a lot less difficult.