The materials tech is pretty amazing, and they've been building it since the early 90s. At least in the past, they were using sapphire crystals and diamond films that have tiny cooling conduits drilled through them with lasers so that you can run (IIRC) liquid helium through the crystals as a coolant.
Even in this configuration, the ablation and thermal loading due to hypersonic transit through the atmosphere has proven to be so high that the optical window is covered in ablative shielding for the first part of the flight, where the terminal guidance package is not much use anyway. Once the missile is within terminal range, the ablative shield is removed and it switches to homing mode. Early tests didn't have the ablation shield, and the damage to the optical window was sufficiently high that the imager lost effectiveness.
The performance envelope within atmosphere of the rocket motors they use for ABM is high enough that it really pushes materials engineering to the breaking point.