Concerning my opinion, we need to use criteria which separates fair and not fair use. It should be the same as with human artist. If you use others' work as inspiration or in a transformative way it's fair use, but if you plainly copy others' work it's a copyright infringement. We need to teach this to ML models like we teach it for artists.

P.S. I am not a lawyer.