Hacker News Reader

Comment by simonz05 | Hacker News Reader

Another option would be to use a service like Cloudflare, which offers protections against scraping and other malicious behavior. This can help prevent the proxy-mirror site from being able to access your site's content.

https://blog.cloudflare.com/introducing-scrapeshield-discove...

View on HN

I have Cloudflare at the front already. The issue is that they are not actively scraping the content but rather mirroring it on demand.

Just an idea but maybe you could cause big loads on their servers by requesting in parallel a large amount of urls where you actively serve a gzipped massive html file that is full of links to your website.

EDIT: or building up on what user zhouyisu says above you can generate your perfect match IP blacklist by calling urls via the abusing site that automatically puts any caller into the blacklist.

I'm not sure how easy would be to serve a "zip bomb" without getting into trouble, but it would be neat

Then where they're coming from should be exceedingly visible in logs (via splunk or whatever), so deny those requests.

If you're on Cloudflare and they're stripping JS wouldn't a JS challenge be appropriate?

https://developers.cloudflare.com/fundamentals/get-started/c...

Pretty anti-user though

Because it requires JS? How about this then...

    a[href*= "sukuns.us.to"] {
     display:none; 
    }

Then use SRI to enforce that CSS.

Enable bot protection in Cloudflare as per your plan https://developers.cloudflare.com/bots/get-started/

Reply on news.ycombinator.com