1,291 karma · joined August 16, 2007
Check out the video: http://www.needlebase.com/videos/video1
Part of Needle is a browser interface that helps you click through a website and tell it what to scrape without writing any code. It's pretty smart about reducing the amount of work you have to do; that starts at 1:50 of the video.
Needle is currently in open beta; try it out for yourself!
I expect that he didn't substantiate his claim for the same reason the original poster didn't substantiate his claim that learning C is a good use of time - people around here who have done both likely appreciate the value of the task.
Meta-point: I think a lot of people around here who argue "school is worthless, why am I doing this useless task" will point to this sort of exercise without asking or understanding why it's done. I certainly felt the same way when I was memorizing Shakespeare. While it's important to think for yourself, it's also important to take the advice of those who have more experience than you do, and when I see these threads I think many of the commentators haven't learned both lessons.
I don't think that you can produce a good newsletter/digest just relying on total up/downvotes. I hoped to find time to apply machine learning to the problem, but never have.
We've been doing those sorts of radius searches for years, although we don't currently integrate street-level data for any customers that I know of. Head to http://matrix2.itasoftware.com, put in where you are, then click "Nearby" - the default is 50 miles, even! Then ask for a calendar of lowest fares. You can even tell it "I want to stay 2-5 nights".
Many of our customers have something similar, but it's not always on the front page.
Either that or he wondered why he needed to tell you what to do every hour.