Hacker News Reader

Comment by cwp | Hacker News Reader

It's not just that it's impossible to capture everything in one database, it's that it's a waste of time to try. There is no format that can capture all nuances and be useful for all purposes.

Data is messy. The only thing you can do with it is preserve the original format that was used to record it, transform a copy to a format that's useful for the analysis you want to do, and join it to other, similarly messy data.

Wikipedia is a perfect example. It's messy as hell. It's blobs of data with connections between them. Most of the blobs are unstructured text (or at best semi-structured) but there are a bunch of images in various formats there, and links to outside datasources in myriad formats and locations. There are some standards and attempts to maintain order, but the whole thing is damn difficult to process by machine. It's a very, very long way from the Semantic Web.

View on HN

It's certainly possible to capture everything a human can know in one database. The human brain demonstrates that it's possible. It might be a bit tricky to capture artifacts that come from messy wetware with something simpler than a simulation of messy wetware, but there is no theoretical barrier to having all human knowledge in one query-able location.

> It's certainly possible to capture everything a human can know in one database.

Storing the information isn't the real challenge, structuring the connections between different pieces of knowledge is what seems to be the very difficult part.

Without the latter, you can have all the data in the world, but no way to make any use or sense of it.

The brain is not a computer and the mind is not a database. It does not store discrete data items.

If it can compute, it's a computer. If it can store and retrieve data, it's a database.

The human brain stores information. I would not call it a database.

Let's start with your statement: "If it can store and retrieve data, it's a database." One of the notable characteristics of human memory is that it is not reliable. It does NOT reliably retrieve the data that it stored -- and I don't just mean that we forget some things, I mean that many of our memories are factually incorrect.

Human memory is extraordinarily USEFUL, but in order for the term "database" to have a useful meaning, I have to categorize human memory as a form of information storage that is NOT a "database".

This would mean that a floppy disc (hardware) and the filesystem used to arrange the bits thereon (software) are each a database. How is breaking down the distinction between database, filesystem, and storage medium helpful?

I think the idea is that it could get closer to the Semantic Web if there were more respect for that kind of effort, and even though it doesn't solve all of the problems with data, it does solve some of them.

Reply on news.ycombinator.com