This is only true of a periodic sound. This is because when the wavelength is smaller than the distance between the ears, there is aliasing in the phase information (ambiguity). However, the overall group delay is perceptible at the onset and cessation of the tone. That doesn't give you much time to latch on to the direction. At high frequencies, though, level differences are useful. You know which ear is facing that chirp and which isn't.