> crawling my top 20 sites and a search depth of 2 for linked sites + wikipedia + IMDb + Wiktionary

I have been thinking something along similar lines. One thing I wanted to add is independent (static site)bloggers and content creators, forums like HN and reddit, stackoverflow etc. But I have no idea how to find these bloggers. Maybe whitelisting the sites to be indexed is the solution?

Everytime I a stackoverflow answer links to some really amazing blog post, it saddens me that google wouldn't have shown me that result even if I searched the exact same topic of the blog post.