Don't crawl the site, please. The place to get data is the HNSearch API.