_ampg

I think that is a valid point. If the noise becomes too much, I would take it down.

Yes, it's not as widely implemented as I expected. Adoption seems to drop quickly. Roughly 20% for the top 10 websites, 15% for the top 100 and about 10% for the top 1,000. It's downhill from there.

Thanks. Someone had done a scan for security.txt files before but were unable to scan the entire Alexa Top 1 million websites. Only the top 1,000. I checked the top 1 million from a 1.5Mbit residential DSL line using Go routines.

The blog post has more details and a short overview of the results. It's linked at the bottom of the repo. I was hoping to get feedback on the code.

https://www.go350.com/posts/a-survey-of-security-dot-txt/