Hacker News Reader

If your potential customers are willing to pay to scrape data, why aren't they will to pay for the data from the source directly? Is it not available or is it considered exclusive or proprietary. I'm thinking about the lawsuits around deep linking and TicketMaster. Web scraping at scale is a never ending arms race because designs evolve or the host is actively trying to thwart you.

View on HN

So for new companies the data (that a lot of time IS publicly available) cost a lot of money, i.e. Api access or charing per requests. A lot of time companies start with scraping and then once they have more customers (and data access price can be shared amongst them) they switch to paying for it.

I like these two questions! They can crystallise things.

Wasn't aware of the Ticketmaster v. Tickets.com case. Will have to print it along the SCOTUS LinkedIn v. hiQ ruling.

Reply on news.ycombinator.com