Hacker News Reader

Scrapes are cached, it is too expensive and too long to do them on-demand based on a live query. Lots of sites change designs frequently and don't output semantic code in the html source either. And good luck getting the customer to prompt correctly for things like background images, gradients, carousels, animations and page transitions.

View on HN

We are actually solving this problem by building the Huggingface Hub[0] for browser automations -automatically tested and updated around the clock, and a homegrown distributed automation framework [1] that can leverage your own browser, your community’s or your team’s up to millions of orchestrated browsers.

It’s not just for AI, we created a custom package format[2] for automations that can run in CLI as a one-off, a REST API server, an MCP server with a single command..

0: https://herd.garden/trails

1: https://herd.garden

2: https://herd.garden/docs/trails-automations

Reply on news.ycombinator.com