All of the websites concerned have strict authorization requirements and none have public APIs afaics. At the start, it just seemed easiest to automatically scrape them. I guess I could have reverse engineer their private APIs and used those - but as the doctors say, the retrospectoscope is a rare and expensive piece of equipment!