OpenAI could argue that because some of the training data was written by them, they have a copyright claim to the output. However, this is a very slippery slope for them as the entire existence of OpenAI is predicated their use of training data being fair use.
OpenAI can only control the output of GPT-4 via their terms of service. When you sign up to use ChatGPT or other services you agree to certain conditions.
Attempting to control what users do in their own time with public domain information from your website may be a step too far for a click or browse wrap ToS.
(All of which may be moot if models can’t be copyrighted because they’re machine-generated.)
For example, can anyone now use GPT4All and there be nothing that OpenAI could do about it?
It’s not about using software but for example creating brochure using embedded asset library provided with software (which is often the case but not sure if that’s in Photoshop).
In imaginary scenario - Meta could have obtained rights to train model on FB data through EULA and could (potentially) extend those rights to “legitimate” users but me using same data to create derivatives could be a problem (and might lead to financial losses).
Something similar to “Blurred Lines” case.