Personally, I think "AI" should be required to disclose the origins of the data it bases it's responses on, and if any of those are copyrighted.
(I'd very much like them to disclose the full scope of their training set, but it's not possible for them to do that on a prompt-by-prompt basis in the way you describe.)