Their intermediate certificates have reference to the location of their Certificate Practice Statement: http://cps.root-x1.letsencrypt.org/
Fortunately, I see that the actual URL linked from letsencrypt.org is https://letsencrypt.org/ISRG-CPS-May-5-2015.pdf
Nonetheless, since http://cps.root-x1.letsencrypt.org is out in the wild, that server should have its HTTPS configuration in working order.