Formalizing the Robots Exclusion Protocol Specification

actual RFC proposal if anyone is curious: https://datatracker.ietf.org/doc/draft-rep-wg-topic/