Localizing the sound isn't just a matter of hearing a phase shift between your ears, you also have some 'knowledge' about how sound moves in a room, how your ears change the sound, and what frequencies will be more prominent given which side of you the sound is made on. The human brain kills it at real time signal processing.