Seriously, though, making robots.txt have the weight of law would be a massive improvement for the ecosystem in general.
Sec. 17-51. Computer tampering. (a) A person commits computer tampering when he or she knowingly and without the authorization of a computer's owner or in excess of the authority granted to him or her: (1) Accesses or causes to be accessed a computer or any part thereof, a computer network, or a program or data; (2) Accesses or causes to be accessed a computer or any part thereof, a computer network, or a program or data, and obtains data or services; (a-10) For purposes of subsection (a), accessing a computer network is deemed to be with the authorization of a computer's owner if: (2) the owner authorizes the public to access the computer network and the person accessing the computer network complies with all terms or conditions for use of the computer network that are imposed by the owner;
It's a good bet that everybody's got equivalent CFAA boilerplate in their terms, so I guess all agentic automations are crimes now.
And Amazon LOST at this stage in the linked appeal, with the 9th Circuit finding that they were not entitled to a preliminary injunction because they were unlikely to succeed on the “access” prong of the CFAA or CDAFA claim against Perplexity.
So, it is doubly weird to conclude “all agentic automations are crimes now” based on the case linked here.