This might be technically correct but doesn't seem to matter much in practice because of how many practical cases of NN outputting copyright-infriging content there are. These include examples in the recent lawsuits that made the rounds on HN. Either even the best specialists behind these NNs cannot make the NNs not contain data that is "massively overrepresented or cliche", or they are unwilling to.