Hacker News Reader

I have a silly website that just proxies GitHub and scrambles the text. It runs on CF Workers.

https://guthib.mattbasta.workers.dev

For the past month or two, it's been hitting the free request limit as some AI company has scraped it to hell. I'm not inclined to stop them. Go ahead, poison your index with literal garbage. It's the cost of not actually checking the data you're indiscriminately scraping.

View on HN

They check after they scrape

That's a lot of time and bandwidth to waste

How? Real people read all millions of pages of internet texts to verify it?

Looks like it’s just scrambling each individual word. Seems straightforward to programmatically look for groups of things that aren’t legitimate words on a page.

How does github feel about this? You are sending the traffic to them while changing the content.

Who cares?

Call the fuzz

Frankly I don't care. They can block me if they want.

Reply on news.ycombinator.com