Might be the only way to reign in the AI bots. By accessing my site with a bot, you agree to reimburse me for that data at the rate of $1,000,000 per character retrieved. Please contact licensing@domain to get set up with payment and access keys
Seriously, though, making robots.txt have the weight of law would be a massive improvement for the ecosystem in general.