Full threadprocaryote·Not having things archived because you explicitly opted out of crawling is a feature, not a bugOtherwise you can whitelist a specific crawler in robots.txtView on HN