this is great! I made one for nail-biters: https://github.com/cacoos/trackhands
4 karma · joined January 11, 2023
If you need cookies/headers, you can always open the browser, log in and then make the same requests in the console, instead of waiting for the browser to load and scrape the UI (by xpath, etc.)
sounds weird going in circles: - SPA call some URL - SPA use the response data to populate the UI - You scrape the UI
instead of just calling the url inside the browser? am i missing something?