Selenium allows you to automate a real browser and capture the
responses, hell if need be you can create a fake profile with Chrome
and make it completely indistinguishable.
Are there no headless browsers that let you accomplish the same thing? Honest question...I've used Selenium, but I just assumed that headless browsers were exactly: real browsers minus the UI.