The article describes how the deployed model can regurgitate chunks of copyrighted works - one of the samples literally ends in a copyright notice.
Sure, some copyrighted works ended up in the Pile by accident. You can download these directly, without the elaborate "poem" trick.