Hacker News Reader

>Theoretically no one should have to crawl the web. The information should be organised when it is entered into the index.

What do you mean by this statement? I can see from your post you have a contrarian view on how to organize and find stuff on the web, but I'm struggling to understand what alternative you're proposing.

View on HN

Well, I'm not him but: probably starting from a zone file and narrowing it down to only whitelisted and "legit" domains would be a good start.

Maybe during the registration process more metadata should be demanded of people and anonymity prohibited or reduced. That way for example if you wanted a list of all the .com blogs it is just a grep away and tied into mostly real people for example. Corporate websites tied to their business entity with an EIN or something and verified. 'etc.

The thing is.. that ship has sailed a long time ago so we are stuck with google.

Reply on news.ycombinator.com