Hacker News Reader

You can do everything you can do with wget - and more - with curl (though it seems to be tending downward on that graph... not very sure what may be the reason for that).

Nice text on HTTP scripting: http://curl.haxx.se/docs/httpscripting.html

And a total aside: http://ifconfig.me/ is extremely awesome. I probably end up using 'curl ifconfig.me' about once a day at least.

View on HN

Wget can do something which curl can't: recursive downloading, and in particular full site mirroring. It's not useful every day, but when I need it I'm glad it's there.

Ah, you're right.

Here's a nice page detailing the differences between the two tools -- apparently written by the creator of curl itself:

http://daniel.haxx.se/docs/curl-vs-wget.html (and a more comprehensive chart with additional tools: http://curl.haxx.se/docs/comparison-table.html )

I'm using wget for a project, basically because it's the only crawler on the planet that given a single URL, can download that page + all images, style sheets and scripts embedded in it without hassle (just with a flag: -p or --page-requisites).

It sucks however, because you can't redirect its output to another program and have to write the output to the file system (more I/O).

Reply on news.ycombinator.com