Google Cloud has an API to crawl a page, but it’s only meant to be used for job postings and live events, so they can add and remove the pages quicker than usual.