If you can see the difference than so can the computer. If the computer can see it we have a discriminator than we can use in a GAN-like fashion to train the network not to make that mistake again.