If you ask me to repeat the contents of a novel I read line by line I can do it too. Is this fair use? Do I have to pay someone?
Good point, are you plagiarising every book you've read every time you remember it? If you recite some of a book to a friend, do you need to pay the author a fee?
I would say not. So why are we talking about LLMs in the same vein?