There is a "back-channel" way for most sites: sitemap.xml
Many sites have it, since it is helpful for SEO. Examples:
https://www.1500days.com/sitemap.xml (Wordpress) https://dri.es/sitemap.xml (Drupal, illegible though) https://aaron.axvigs.com/sitemap.xml (Drupal, legible)