Wikipedia and irregular data: how much can you fetch in one expression?

zverok.github.io

23 pointspetercooper3 comments

This project reminds of what Wikidata does: organize facts as semantic triples [1] using inheritance in the way OOP does.

Example about our planet: https://www.wikidata.org/wiki/Q2

[1]: https://en.wikipedia.org/wiki/Semantic_triple

I thought that as well before reading.

Now I'm thinking the two things are more complementary.

This project seems like a domain specific web scraper, targeted at common usages found on Wikipedia.

There's so much data in Wikipedia that it's a good target for this.

So one combined use would be scrape Wikipedia to find mentions of e.g. tour de France cyclists and then ensure that they are correctly tagged in wikidata.

The author talks more about wikidata in earlier post in the series about this.

> This project seems like a domain specific web scraper, targeted at common usages found on Wikipedia.

This is pretty much what DbPedia does, FWIW. But Wikidata has the benefit of being built for the actual purpose of hosting structured data, regardless of language.

Reply on news.ycombinator.com