Since we're warm-blooded animals, maybe it's because IR vision would be swamped by the emissions of the eye itself?