Having to serve 1000x more traffic from bots is completely unacceptable for most site owners as well.

The fact that this trade-off isn't obvious indicates you haven't tried to run a site at scale and make a living off of it.