Why doesn't someone build the site-scraper, and provide an API to its results?
On the other hand I am not trying to rule out viable alternatives by suggesting it comes straight from HN, I even considered making what you are saying at one time. I just don't think it would be as good as an HN one.
Still though, I suppose some sort of site-scraped data (perhaps hosted on google apps for everyone to use) could be used in tandem with a greasemonkey script to further enhance the site without taking away the interactivity, that could be interesting...