Perhaps because you can request a page of items at a time? For something like this an even better alternative might be the BigQuery dataset: https://cloud.google.com/bigquery/public-data/hacker-news.