The Hero browser is designed for this kind of sneaky scraping, it’s very interesting: https://github.com/ulixee/hero