My preferred "self-hosted" webscraper is a local, single binary called xidel [1]. The feature I really like is that it can also follow links.
and it still uses Pascal because I didn't plan to change it but just wanted to show people what I programmed 20 years ago
There was actually just a large discussion thread in the Lazarus forum wondering about why it is not more popular, with almost 300 comments. But now the thread got locked. That might be a reason.
I used Delphi on Windows 98. But that became outdated, so I ported it to FreePascal. FreePascal has a lot of integrated libraries, but I do not really use anything I did not already use with Delphi.