This sub-bit jitter and interference can travel along with a digital file and sneak right past your ordinary bit-level error detection and correction, no matter how lossless you make it. That's because these errors aren't visible in the bits. They occur at a deeper and more subtle level, in between the bits.
Even if you prove mathematically that two files contain the exact same bits, you can't prove that the human ear won't hear any difference, can you?