It actually also works because a sound registers differently based on the direction it travels through your own head (i.e. your skull itself is an occlusion source) - your brain recognizes front vs. back based on how your own head dulls the sound
And I wonder, why else would we have such oddly shaped ears?