If your provider has an API for the firewall/protection, just use fail2ban with cURL to block certain traffic.

This can be done with Cloudflare using this action: https://github.com/fail2ban/fail2ban/blob/master/config/acti...