Because it adds another dimension to the sound you're experiencing and gives you a whole new appreciation for the medium.
This combined with binaural audio should be the future of audio storytelling.
Give this a try with any normal headphone: https://www.youtube.com/watch?v=IUDTlvagjJA