What if the content you want to scrape->API is behind a login gate? Is there an option of authentication?
That endpoint will then emit a state token, which includes the session cookies. You can feed that state token into your next request and it'll authenticate you