Improving consistency in a Go crawler with retry logics and network tuning

A blog about how I improved consistency and performance in a Go crawler.