From what you're saying it sounds like what we need is a search engine for indie sites. There's already one for old-school sites but this would work better as a directory type of deal (or webring) of old times where the sites would still be crawled and indexed so the content is fresh. One of your requirements was never a requirement for the big web either. Namely that sites are up 20 years later. I don't think that's necessarily a problem.