Hacker News Reader

I have a question. How do you get the catalogue of books? Have you had to scrape a whole bunch of book stores, or do you make a ton of api calls? Do you store all the catalogues on your server, or are you calling a search on each of these sites live?

View on HN

It's both scraping book stores and calling APIs, I do not currently index anything and do all searches live. I'm working on building in caching and eventually indexing to make everything more efficient, but since the async live searches take roughly 4-7 seconds it's not too bad at the moment.

Interesting, thanks. I do wonder how much space it would take to cache every bookstore.

I'll let you know in a few weeks

Reply on news.ycombinator.com