"Web scraping is fragile!"
Can you give any specific examples (sites and data needed from them).
Can you give any specific examples (sites and data needed from them).
Every few weeks or months, one of the comics would just not appear or not be updated (i.e. there was the same strip day after day). I had to update the code each time, checking the source code and finding the new page and location of the image. Later, some pages started using JavaScript to load the image file, and I lost interest in sophisticating my script. So, no single page comic collection for me anymore. :)
Set up a cron job to run `dosage @` every day, it will check for new comics and download them.