That's true of all statistical models, it's not some magic property of neural networks.