Cool !! Is it robots.txt compliant? If not, it might be a good idea to make this available as an option/parameter.

For 'quick and dirty' tasks, wget -r can come in handy too.