It's vibecoders all the way down. I'm sure Anthropic et al. would like to reduce their resource waste if they could, seeing the insane amounts of money they're bleeding. But I had to come to the conclusion that these LLM companies have not a single developer good enough to implement a decent scraper. Their tools produce garbage code and they don't know enough about programming to realise it, or do anything about it.