Hacker News Reader

A distributed network of cooperating independent crawlers and indexers would be cool though.

you might want to look at yacy for that.

There's a blockchain for that.