I was planning on building a Caddy module for Anubis actually. Is anyone else interested in this?
Yes, I would! I love Caddy's set and forget nature, and with this it wouldn't be different.
Especially if it could be triggered conditionally, for example based on server load or a flood being detected.